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Abstract 


Genetic algorithms are the optimization procedures which mimic the working of nature m solving 
pioblems In their earlier form, the problem variables are represented m binary notation This GA is 
called binary-coded genetic algorithm (BCGA) However, there are certain problems associated with 
this form of GAs Other form of coding such as real number representation have been suggested for use 
in GA This representation seems to be natural for optimizing problems having variables in continuous 
domain 

Real-coded genetic algorithms (RCGAs) have been found to be very efficient m optimizing real world 
pioblems These use real number representation for the problem variables The RCGAs have seveial 
advantages over the traditional binary-coded genetic algorithms (BCGA) The RCGAs differ from the 
BCGAs m the coding of problem variables, the crossover operator and the mutation operator 

The crossover operator is believed to be the mam search operator m the working of a genetic 
algonthm since it is primarily responsible for creating the children population m the search space The 
peifoimance of a real-coded genetic algorithm largely depends on how good the crossover operator is 
m exploring and exploiting the search space A number of crossover operators for RCGAs are available 
in the literature Since the crossover operator is so important, therefore it essential to find out the 
desirable properties of a crossover operator that it should have for the algorithm to perform efficiently 
In the present work first an description of different evolutionary algorithms using real number rep- 
lesentation has been given and then after a number of crossover operators available for RCGA have 
been analyzed taking the postulates suggested by Beyer and Deb (1999) as the base The postulates are 
on the mean preservation and variance evolution characteristics of the evolutionary algorithms Based 
on the postulates, the crossover operators have been analyzed for flat fitness landscape The variance 
evolution equations for these operators have been obtained The values of the characteristic parame- 
tei values associated with different crossover operators have been found for which the various RCGAs 
implementing different crossover operators will perform similarly m flat fitness landscape These differ- 
ent algorithms have been tested for their similar performance on other landscape taking values for flat 
fitness landscape Later the crossover operators have been classified based on their mean preservation 
and variance evolution characteristics and guidelines for the design of an efficient crossover operator has 
been suggested 
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Chapter 1 


Introduction 


Real-Coded Genetic Algorithms ( R C GA) are the search algorithms based on natural evolution These 
have been found to be robust search algorithms to solve complicated problems The RCGA works with 
a population of the candidate solutions of the problem, applying several operators on this population 
These opeiators are 

• Selection 

• Ciossover 

• Mutation 

The crossover operator is believed to be the mam search operator in the working of a genetic 
algonthm since it is responsible for creating new children from the population given by the selection 
opeiatoi The performance of a genetic algorithm largely depends on how good the crossover operatoi is 
in exploring new regions m the search space by exploiting the regions as given by the selection operatoi 
So it is essential to have a good crossover operator to explore and exploit the search space so as to give 
lastei convergence to the optima avoiding premature convergence Mutation operator is also used in 
GA but it is used only as a backhand operator with small probability to perturb the value of the paient 
by a little amount 

Tlieie are a number of crossover operators that have been proposed by many researchers for leal- 
< odecl genetic algorithms Each one of these operators has been claimed to be performing bettei on 
<ei tarn test functions m comparison to some previous operator Since the crossover operator plays an 
unpoitant role in the search procedure so it is necessary to find out properties of a crossover operator 
with which the algorithm could perform efficiently m optimizing the problems 

1.1 Literature Survey 

The genetic algorithms( GA) are the search algorithms based on the natural evolution The GAs 
woik on a population of the candidate solutions for the problem to be optimized The mam steps in 



the working of a GA are the selection, the crossover and the mutation as have been pointed above 


111 Binary Coded Genetic Algorithms 


The eailier form of the GAs is the binary-coded genetic algorithms (BCGA) In BCGA the problem 
\ec toi is coded m the bmaiy bits 1 e (0,1) The variables are transformed m to the binary piesentation 
and concatenated so as to form one big string which represents a vector This concatenated string is 
called an uC individuaF The GA start with a population of these randomly generated individuals The 
vanables aie transformed back to the real space by using a linear mapping as below 

(g? - x i) 


Xi = X, + 


2 ii 


1 


-DV 


Heie i varies from 1 to n (no of vanables) x[ and rc“ are the lower and upper bounds on the 
vanable Xt respectively, l t is the string length for the i th variable and DV is the decoded value of the 
bmaiy representation for this variable With the binary coding, the accuracy that can be obtained m 
the solutions is given by the fraction term of the above equation Thus BCGA works by discretising 
the search space 

The selection operator m the GA works on the principle of “Survival of Fittest” The fitness here 
is the value of objective function that is to be optimized in maximization problem In minimization 
pioblem the fitness is usually defined as the function where obj is the objective function value at 
the particular point The selection operator chooses the fitter solutions to form the mating population 
The different selection techniques used are, 


• Roulette Wheel Selection 

• Stochastic Remainder Selection 

• Tournament Selection 

On the mating pool of the individuals as given by the selection operator, the crossover and mutation 
opeiatois work to form the population for the next generation In the crossover two parents are randomly 
selected from the mating pool and a cross site is randomly generated, the two children solution are 
obtained by swapping the portions of these parents that are on the right of the cross site This operator 
is known as the “single point crossover” There are other crossover operators for BCGA also available 
as li-pomt crossover and uniform crossover The mutation operator works by randomly inverting the 
bit of an individual with a certain small probability This forms the population for the next generation 
Since the BCG As work with a binary coding of the variables, these discretize the search space m solving 
the optimization problems having continuous search space This discretisation results in problems m 
the BCGA The problems associated with the BCGA are described next, 




Figure 1 1 A simple ummodal function 

1 Any arbitrary precision m the result can not be achieved instead the piecision in the lesult depends 
on the length of the string used to represent the variable 

2 The BCG A needs the knowledge of the bounds on the problem parameters to do the linear mapping 
horn the binary to real search space The knowledge of the bounds on the problem parameters 
generally is not available m the real world problems 

3 Inherent Hamming-cliff problem associated with the binary coding 

4 All Holland schemata are not important 

The first point is because the BCGA discretizes the search space for creating the solutions This 
limit the piecision that can be achieved in the solution For more precision we need to use larger stung 
length with results m large computation time 

Since we have to do the linear mapping of the binary representation to the real space to get the 
values of parameters, we need to know the bounds on the problem variables This is not likely m the 
leal-woild problems 

With the binary representation, to obtain a neighourmg solution we may have to flip several bits 
This may cause the GA to take longer computation time and also the GA may get stuck 

The fourth point may be explained with the help of Figure 1 1 Considering it to be a minimization 
pioblems, fiom the figure it is clear that the left portion of the search space between lower and upper 
bound contains the global optima The the bit strings having zero at their left are more important since 
these aie the representative of the left half of the search space 

Thus the schemata which represent the left half are more important than those which represent the 
light, space So the processing of the schemata having 1 at the leftmost position is not needed heie 


Since the binary coded GAs search only within the given lower and upper bounds, these are not 
suitable foi the problems where the range m which the optima lies is not known apnori since m this case 
it is necessary to generate the children points outside the initial bounds These are also not suitable foi 
the problems m which the optima is time dependent 

1 1.2 Real Coded Genetic Algorithms 

The leal-coded genetic algorithm (RCGA) differs in many ways from the binary-coded GA as follows, 

• Coding of variables 

• Crossover 

• Mutation 

These differences are described m the following 
Coding of Variables 

In RCGA , the variables are directly coded into real numbers So a concatenated string 1 e an individual 
v Inc h is a collection of binary bits 0 and 1 in case of BCG A, is a collection of real numbers in RCGA Thus 
the pioblem of achieving arbitrary precision with the BCGA is eliminated m RCGA since the floating 
point lepiesentation is directly used The real number representation of the problem parameters also 
eliminates the problem of Hammmg-chff (the need of alteration of many bits m order to get a neighboring 
solution m real space) with BCGA 

Crossover 

The crossover operation m the real coded genetic algorithm is different from that in the BCGA since 
we are using real numbers to represent the variables, the operators which are used in BCGA would not 
be effective m the RCGA Here the crossover is done using some distribution of the population and 
the children points are created using this distribution One such crossover operator is flat crossover m 
which one offspnng is created as, 


Vi = (1 - ol)x] + ax^ 

Here y t is the child, x) and x‘l are the parents a is a uniformly generated random number m 
the range (0,1) Here this crossover operator generates a child uniformly and randomly from the span 
bounded by the two parents Other crossover operators are described m Chapter 2 



Mutation 


Like ciossover, the mutation operation also uses a probability distribution m generating a point fiom the 
paient It perturbes the value of a variable by a little amount to some neighourmg value One mutation 
opeiatoi which has been proposed for the RGGA is the “Non-umform Mutation” by Michalewicz,1992 
This woiks as follows, 

If the operator is being applied at generation g and g ma x is the maximum number of generations 
then 

, _ f y* + A(s, &» - yi) if t = o 

1 \ y t - A(g,y z -a 2 ) if r = 1 

Heie a z and b t are the lower and upper bounds on the i th variable r is a random number which can 
have a value 0 01 1 and the operator A is defined as, 

A (g,y) = y 

where rG (0,1) and b is a parameter chosen by the user Other mutations operators ha\e been 
described m Chapter 2 

1.2 Objective 

The present work aims at determination of the desirable properties that a crossover operator should 
posses to perform efficiently There are a number of crossover operators for the real-coded genetic 
algorithms available m the literature, proposed by different researchers 

In the present work, the mean and variance of different crossover operators has been explored for 
the flat fitness landscape case on the basis of postulates proposed by Deb and Beyer, 1999 The different 
ciossover operators axe then checked whether they follow the postulates The analysis includes checking 
whethei a crossover operator preserves the mean of the parental population and the determination of the 
vai lance evolution equation for different crossover operators The values of the characteristic parameter 
associated with different operators is also presented for which the different operators will perform 
similaily in the flat fitness landscape Thenafter the GA runs implementing different crossover opertois 
have been carried out on the landsapes other than flat fitness landscape to check the significance of the 
values obtained for flat fitness landsape Finally the operators are classified according to the properties 
they posses and suggestions for the design of crossover operators is presented 

1.3 Organization of the Thesis 



The thesis is organized as follows 



In Chapter 2, different evolutionary algorithms which use the real number representation of the prob- 
lem paiameteis have been described These algorithms include “Real-coded Genetic Algor ithms (i?CG 4 ) 
Evolution Strategies(E5)”, “Differential Evolution (DE)” and “Family Competition Evolutionary Al- 
gol ithm{FCEA)” 

In Chapter 3, the analysis of different crossover operator for the real coded genetic algorithms is 
peifonned and the theoretical predictions are compared with the simulations 

Chapter 4 includes the results that have been obtained by running simulations on sphere and ndge 
model, foi different RCGAs having different crossover operators 

Chapter 5 includes the conclusion and discussion on the behaviour of different RCGAs and the 
suggestions for the future work 



Chapter 2 

Real Parameter Evolutionary- 
Algorithms 


la tins chapter the evolutionary algorithms using real number representation are discussed First the ical- 
( odcd genetic algorithm (RCGA) is discussed and then after the evolution strategies (ES), differential 
evolution (DE) & family competition evolutionary algorithm ( FCEA ) are presented 

2.1 Real Coded Genetic Algorithms (RCGA) 

As discussed in Chapter 1, the RCGA works with a population of randomly generated individuals of 
the problem vector applying operators like selection, crossover and mutation The performance of the 
RCGA is largely dependent on the crossover operator since it is responsible for creating the solutions 
using the parental population Mutation operator is also used but it is meant only for perturbing a 
paiticular solution locally by a httle amount Crossover operator is used for finding the global solution 
The pioblems with the earlier version of GA le BCG A have already been discussed in Chaptei 1 
RCGA eliminates these problems and has following advantages, 

1 With the use of real numbers directly to represent the variables, it is possible to use large domains 
m the search specially m the problems m which the location of the optimum is not known which 
is generally the case In BCGA if larger domain are used it is necessary to use larger string length 
which results m higher computation cost and time 

2 The inherent Hammmg-cliff problem is completely removed m the RCGA because of using iea.1 
numbers directly 

3 The use real numbers m representing the problem parameter facihtates the achievement of any 
desned accuracy m the solution 

In the following the different concepts and operators used in real-coded genetic algorithms are 


dcsciibed 



2 11 Schemata Concept as related to Real-coded Genetic Algorithms 

The mam theoretical advantage of the binary coded genetic algorithms is that the processing of BCG A 
is well defined on the basis of schema theorem The schema as defined for BCG A is a similarity template 
that desenbes a subset of the strings with similar features at certain positions The schema is a string 
defined ovei the length of the individual with mainly three values a zero, an one and an asterisk (*) The 
* is a wild card or don’t care symbol 1 e it represents either a zero or an one In binary GA, it has been 
shown theoretically that the above average schemata get more copies in the coming generations For an 
example an schema for an string of length 7 may be *11*010 It is an representative of following four 
solutions {(0110010), (1110010), (0111010), (1111010)} The order of a schema is defined as the numbei 
of don't care symbols available m the schema For the above schema the order is 2 The other term 
which has been defined for the schema is its defining length It is difference of positions of the two 
oxtieme don’t care symbols 

The concept of schema for real coded GAs have also been proposed by many researchers The 
difteieut terms proposed for analysing the RCGA are presented below 

Wright’s Connected Schema 

In (Wnght, 1991), Wright studied the meaning of the classic binary-coded schemata for continuous 
functions m terms of real parameters Wright defined the meaning of binary single point crossover as 
the generation of child having more significant part of one parent and less significant part of the other 
Thus he aigued that on the real space the child can be considered as a perturbation of the one of the 
paieuts The maximum size of the perturbation for parameter i is R l 2~ k Here R t is the range of the 
parameter and k is the cross site chosen to do the crossover The perturbation obtained correspond to 
the difference of the less significant bits i e bits on the right of the cross site 

He defined the schemata which have contiguous *’s on the right end of string as connected intervals 
of the leal numbers The schema whose *’s are not all contiguous at the right end corresponds to a 
disconnected union of intervals He defined these schemata which represents the connected intervals of 
the leal parameters as “connected schemata” 

He defined the schemata for the real genes by restricting some or all of the parameters to subintervals 
of then possible ranges If the variable l has lower and upper bounds as a, and b t the parameter space 
(au be represented as, 

P = It; l°*A] 

and a schema s is specified by choosing real bluer a t and such that a t <a 2 </3,<6j To each schema 
s a template is associated as below 



If a parameter is unrestricted 1 e a l = a l and f3 l = b l , &* is associated with this schema If a parameter 
is lestricted 1 e a, > a t and /3 t < b u I t denotes its interval So an schema is given as 

Foi example if the parameter space is [—1,1] x [—1,1] x [—1,1] and is the schema is [—1, 1] x [0, 1] x [-1 0] 
the corresponding n-tuple would be *I 2 Iz 

Virtual Alphabets and Blocking 

To explain the working of real coded genetic algorithms Goldberg (Goldberg, 1990) proposed the theory 
of nut ii al characters and virtual alphabets He tried to make it compatible with the schema theoiem foi 
hmaiy coded GA so as to predict the behaviour of the RCGA 

Goldberg postulates that m the working of a genetic algorithm, selection dominates the GA search 
by cutting the search space m to domains where the points having above average fitness reside So in 
the early phases of search, the search space gets reduced to certain regions where the fitness is above 
aveiage It has been already shown (m Goldberg and Deb 1990) that the number of generations needed 
foi the above average points to take over the populations is g =loglogn p Here n p is the population 
size and g represents the number of generations So even if the population size is 10 9 , the numbei of 
geneiations for the selection to dominate is merely 5 

He explained the action of selection m terms of slices of the fitness function The different terms are 
stated below, 


Slices The mean slice represents the average value of the fitness function averaged over the mtei vals 
of vanables Mathematically, 


- i r b 

<f>{x i) = t / (j> (aii, x 2 ) dx 2 

b-aj a 


The mean slice can be obtained for different values of x\ from the above function Similarly the 
global slice can be defined by fixing the value of x 2 at global optimum le , x* 2 ) The 

mat, slice may be obtained by varying x\ and choosing the best <j) value at each point ranging over all 
possible z 2 values 

Considering an appropriate probability density function f(x), xsQ, the marginal density function 
fi ( 1 1 ) for the subset of n real variables specified by the index set I may be calculated as 


fi{xi) = / f{x)dQp 

j Qji 

wlieie I 1 = {1, n) — I The mean slice cj)j or the expected value of <p with respect to / and the fiee 
vanables x,, i£l may be calculated as follows 



<M a: /) = / fi'{xr)<t>{x)dQ.ii 

J ttj 

where dClp — an d fi/' 1S the indicated 1 1' [-dimensional subspace of Cl spanned by fixed 

vanables A point slice is defined as the function obtained by setting x : = x 3 for point x = a with 
inspect to the index set I and allowing other variables vary freely 

Virtual Characters and Alphabets With the definitions of slices and the functions developed 
above a rigoious statement regarding the above average intervals was developed Considering only the 
mean slices of over the singleton index sets, the one-dimensional mean slices <f) l , a virtual character 
may be defined as a non-empty intersection of a basin and a feature on <j> t , and a virtual alphabet is 
simply the collection of virtual characters along a given direction The figure 2 1 shows these concepts 
In the figure the selection set is divided into two features and four basins The first feature (F\) contains 
poitions of two different basins (B i and B 2 ) and is divided into two virtual characters (Ci and C>) 
The second feature (F 2 ) contains a portion of only one basin and as a result has only a single charactei 

(C'b) 



Figuie 2 1 A mean slice, its basins, its features and its virtual characters (Taken from Goldberg, 1990) 

The processing of the virtual characters and virtual alphabets can be seen by considering the fig- 
uie 2 2 Heie the variable x\ is coded on a ternary alphabet and X 2 on a binary alphabet The regions 
of likely subsequent search are shown as the cross-hatched intersections between virtual characters on 
difleient dimensions 

Interval Schemata 

Eshelman et al m 1993 proposed the concept of interval schemata for the analysis of RCGAs Since 
the computers have the limited precision, any real- valued value may be mapped on to an integer So 




Figure 2 2 The cross-hatched regions are likely to be processed by the algorithms (Taken from 
Goldbeig, 1990) 

they suggested the RCGA to be called the integer-coded GAs 

Analyzing the crossover operators for RCGAs, it may be observed that they exploit the intervals 
determined by the parents rather than the patterns of the symbols they share The BCG A were 
developed for strings of symbols, which is too restrictive for analyzing the RCGA Something analogous 
is needed for RCGA that manipulate intervals rather than the bit values From this idea the concept 
of interval schemata arises An interval schemata, i, is defined as 

n, =1 (<*»»&) 

with a t ,p t e{ 0 , 2 l '} and 

The Wnght’s connected schema and interval schema may be compared by considering a parametei 
) with lange (0, 2 Ll ) For this parameter there are 2 L,+1 - 1 connected schemata , however tlieie 

■)L r ( e )L l ii \ 

are - — -3— — ; interval schemata which represents a larger quantity Thus interval schemata represents 
connected as well as disconnected intervals 

Formae 

In (Radeliffe, 1991a) the notion of implicit parallelism is extended (and the associated schema theorem) 
to general non-stung representations through the introduction of aibitrary equivalence relations In 
doing so it provides a framework within which arbitrary genetic operators may be usefully analyzed 
Schemata are generalized to formae which are equivalence classes induced by equivalence relations 


over search space The aim is to maximize the predictive power of the schema theoiem by allowing 
the developer of a GA for some particular problem to code knowledge about the search space by 
specifying families of formae that might reasonably be assumed to group together solutions with related 
pcifonnance and developing operators which manipulate these to good effect Radchffe presented design 
pi maples for building useful equivalence relations The following principle are related to crossover 
opeiatois 

1 Respect Crossing two instances of any forma should produce anothei instance of that forma 

2 Proper Assortment* Given instances of two compatible formae (e g the ones where there aie 
a chromosome being an instance of both), it should be possible to cross them to produce a child 
which is an instance of both formae 

In (Radcliffe, 1991b) four different types of formae in conjunction with operators for their effective 
manipulation are discussed The first is related to standard schemata the second to the o-schemata 
introduced m (Goldberg, 1989a) to manage permutation problems the othei two are the edge formae 
defined to deal with chromosomes that represents edges and locality formae which relate chromosomes 
on the basis of their closeness to each other and are applied to problems with continuous parameters 

In (Radcliffe, 1991a) the formae to manipulate real coding are discussed again Two properties aie 
(onsideied to be captured by formae namely locality and periodicity The author presents two types of 
equivalence relations to induce formae describing these properties 

Above mentioned are several schemata like concepts developed for real-coded genetic algorithms 
One common feature of all the concepts discussed above is that all of them represent certain contiguous 
spaces or intervals m search space These concepts can be used to predict the behaviour of the real-coded 
genetic algorithms 

2 1.2 Crossover Operators 

Theie are a number of the crossover operators available in literature for RCGA that have been proposed 
by many researchers from time to time The crossover operators available for RCGA are described in 
the following subsections, Crossover operators in real-coded Genetic Algorithms (RCGA) can be divided 
in two parts, namely 

1 Two Parent Recombination 


2 Multi Parent Recombination 



2 13 Two Parent Recombination 


In two parental recombination, two parents participate m crossover and create children Most of 
ciossovei operators proposed for RCGA are of this type The crossover m multi-variable problems 
is done using any of the following techniques, 

• Line crossover - The children points are generated along the diagonal formed by the parents 

• Variable by variable - The crossover is done considering each variable separately 

Let us assume x 1 = (re}, x * ) and x 2 = {x\,x\, x\) be two parents which have been selected 

foi the ciossovei from a n-dimensional search space The counter % is running from 1 to n The different 
{ lossovei operators are described below - 

Flat Crossover (Radcliffe, 1991) 

Tins operator produces children points on the diagonal of the hypercube formed by the parents This 
is a line crossover 

An offspring y = (yi,j/2? Vn) is generated uniformly from the interval (x^x^) as 

^ = (1 - a)xl + ax\ (2 1) 

a € (0, 1) and remains same for all values of i in one crossover operation This way the children 
points aie being generated along the line formed by joining the two parents, Figure 2 3 



Figure 2 3 The children points are generated along the diagonal formed by parents 

Tins operator produces children points only m the region spanned by the parents s 

[ 

Simple Crossover (Wright, 1991; Michalewicz, 1992) 

This ciossover operator is same as Single Point Crossover m Binary Coded Genetic Algorithms (BCG A) j 
The children created with this operator he on one of the corners of the hyper-cube formed by the parents ' 
c'xc ludmg the corners occupied by the parents A 2-D case is shown m figure 2 4 Here a cross site I 



/, £( i 2 n — 1) is randomly chosen and the right side of two parents are swapped to give two offspimgs 


as 



Figure 2 4 Simple Crossover 
Arithmetical Crossover (Michalewicz, 1992) 

This operatoi creates children points along the extended diagonal of the n-dimensional hypercubc as 
foimed by the parents The children points created are the corner points of the diagonal of the extended 
hypeicube A 2-D case is shown m figure 2 5 If the value of parameter A > 1 0 the children points will 
be the corners of the extended hypercube If A < 1 0 the hypercube will shrink and children points will 
be coiner points of this hypercube 

Two offsprings y 1 = y\) and y 2 = (y? , , y„) are generated as 


Vi = Aar* + (1 - A)a; 2 

(2 4) 

yl = (l - AK 1 + \x\ 

(2 5) 


A is a pre-specified constant This constant A makes this operator a deterministic operator because 
foi any two given parents we will always get same offsprings since value of A is fixed 
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Figure 2 5 Arithmetical Crossover 

Tins operator can be thought of as a discrete case of line BLX-a crossover operatoi 1 e in this case 
wo only take the extreme points Depending on the value of A, the children points can be geneiated 
inside the range of parents or outside the parents 

BLX-a Crossover (Eshelman et.al., 1993) 

This opeiator creates the offsprings by randomly picking the points from the hypercube obtained aftei 
extending the hypercube formed by the parents by a factor of a in all the directions In its piesent form 
this operator is applied variable by variable 

An offspring y = {yi,y%, Vn) is randomly created from the interval defined over [x min - la] to 
- la], where x mtn = mm(xl,xf), x max = max(x],x 2 ) and I = x m ax ~ x mm assuming r| < zj as 
follows, 


Vi = (1 ~ + fa* (2 6) 

i is uniformly generated random number in the range (-a, 1 + a) This operator picks up points 
unifonnly from a hyper rectangle formed by extending the parents by an amount al in both sides of a 
diiection A 2-D example is shown m Figure 2 6 

Linear Crossover (Wright, 1991) 

This operator produces three offsprings y 1 = (y\, y\, y\), y 2 = {y\, y\, yl) and y 3 = [y\ y\ , y* ) 

tiom two parents xf and x 2 as 


Vi = + ifi 


(2 7) 




Figure 2 6 BLX-O! The children points are randomly uniformly picked from the rectangle formed by 
the two parents 


2 3 i 1 2 

v ' = 2* 1 ~ 2 Xl 

(2 8) 

= ~\ x \ + \ x2 i 

(2 9) 


The two best offspring replace the parent m the next generation, Figure 2 7 

This operator can be considered as a discrete case of BLX-0 5 as two extreme and one midpoint aie 
being created as the children solutions 



Figure 2 7 Linear Crossover 


Discrete Crossover (Muhlenbein et. al., 1993) 

This opeiator is more or less similar to the simple crossover l e the offsprings generated by this operator 
aie also the coiners of the hypercube formed by all of the points m the parental population The 
difference between this operator and the simple crossover is that here for any dimension the value of the 
child is randomly selected from the pool of all the values of the parental population of that dimension 
while in simple crossover two parents are selected and any child is selected from the pool of values of 
those paients only 

An offspring y t is generated by randomly selecting the component from the set (re* xf) 




Extended Line Crossover (Muhlenbein et al , 1993) 

This opeiatoi is same as the line version of BLX-0 25 

An offspring y = (y 1,2/2, Vn) is created from two parents as 


y t = x\ + a{xl - £j ) 


(2 10 ) 


o is uniformly chosen random number from the range (-0 25, 1 25) and is same for all * = 1 2 n 
This operator produces offspring on the line formed by joining the parents, Figure 2 8 



Figuie 2 8 Extended Line Crossover Generates points on the extended diagonal formed by parents 

Extended Intermediate Crossover (Muhlenbein, 1993) 

A 11 offspring y = (yi,y2, Vn) is generated as follows 


Vi = x\ + a t (:Ej -xl) (2 11) 

a t is uniformly generated random number from the range (-0 25, 1 25) 

This operator is same as BLX-0 25 The child is randomly picked from this extended hypercube 

Wright’s Heuristic Crossover (Wright, 1990) 

If x 1 is better m fitness than x 2 , a single offspring is generated as 

y t = £( 2 :* - x 2 t ) + x\ (2 12) 

£ is uniformly generated number from the range (0,1) 

Since this operator produces children points near the parent which is better m fitness so it introduces 
bias towards the points in the parental population which are better in fitness (Figure 2 9) Thus over 
geneiations it tries to shift the population m a certain direction which depends on the fitness landscape 
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Figure 2 9 Wright’s heuristic operator Parent 1 is better m fitness 
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Figuie 2 10 Linear BGA crossover The child is randomly picked from the thick portion near first 
paiout 

Linear BGA Crossover (Schlierkamp-Voosen, 1994) 

This opeiator is based on Muhlenbem’s mutation described m the next section 
In this operator an offspring y = {yi,V 2 , Un) is created as follows, 


y l = x\ ± rang^A 


(2 13) 


Hoie rang , = 0 5(6 l — a,) where b z and a t are the upper and lower bounds on the i ih vanable 
lespectively 7 = Ylk= l Q a k.^~ k where a € (0, 1) is chosen with a probability yg The -ve sign 111 the 
above equation is chosen with a probability 0 9 and A is defined as 


A = 


xt 


x; 


As can be seen, the operator also gives a bias to create the offspring near first parent Figure 2 10 


Unfair Average Crossover (Nomura and Miyoshi, 1995) 

This operator can be considered as an extension of the single point binary crossover m that here also 
a ( loss-site is chose randomly over the length of the individual and the crossover is done differently foi 
t he vai tables falling on left and right side The difference is that here the variables m parent individuals 
>ue blended instead of swapped The crossover is done as below. 

This operatoi produces two offsprings y 1 = {y\,y\, ■ y\) and y 2 = (y\,y\^ Vn) as follows, 


f (1 + ol)x\ - a.x\ i = l,2, 3 

\ -ax\ 4 - (1 + u)xl 1 — 3 + I, n 


(2 14) 


( (1 — cx)x\ + OLxl 
\ ax l + (1 ~ <*) x i 


(2 15) 


i = 12, j 

1 = j+1, n 




Figure 2 11 Unfair average crossover 
Hoie a is a constant and j is randomly selected from (0, 1, n) 

The children solutions are positioned according to the value of a selected A 2-dimensional case is 
shown m figure 2 11 As can be seen, one child is inside the rectangle formed by the parents and othei 
one is outside near first parent If a < 0 5 both of the children will be nearer to the first paient one 
inside the hyper-cube (m case of multi-dimension problem) and other outside it On the other hand 
ll cv > 0 5 both of the children will be away from first parent, one inside the hyper-cube and othei 
outside Foi a > 1 0, both parents will be outside the hyper-cube 

Fuzzy Connective Based Crossover (Herrera et al., 1994) 

Heie a set of four crossover operators are suggested which generate offsprings m different regions of 
search space These operators are named F, S, M & L (Figure 2 12) and these are associated with fuzzy 
connectives T, G, P & C respectively These crossover operators generate offspring as 


F(yl,Vi) = a l + (k - aO^ 1 ^) 

(2 16) 

S(y},yi) = a* + {bi - a l )G(s 1 l ,sf) 

(2 17) 

M(yt,y*) =a t + (b 2 - a z )P{sl,s l) 

(2 18) 

L(yl,yi) = a t + (b t - a t )C(s], s?) 

(2 19) 


* ^ * n ~" (X O ^ 

a, and 6, are lower and upper bounds on the parameter i s, = an d s t — 

The fuzzy connective used are as below 
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Figure 2 12 Fuzzy Connective Based Crossover Operators 
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Table 2 1 Fuzzy Connective Based Crossover Operators 


These fuzzy connectives fulfill following properties 

T 4 <T 3 <T 2 <T 1 <P j 0 = 1 , 4 ) <G1<G2<G3<G4 

As is cleai from above table for fuzzy connectives, these crossover operators are deterministic because 
foi any given two parents we will always get the same child from a particular operator 

Fuzzy Recombination Operator (Voigt et al., 1995) 

This recombination operator produces offspring from a triangular probability distribution having a 
modal values at the parents Let two components of the parents x 1 and x 2 be x\ and x% respectively then 
the piobability that the offspring has a value y x is given by a bimodal distribution p(y 2 )€{4>(x|), )} 

with tnangulai probability distribution $(r) having the modal values xj and x\ with 

xl - d{x* - xl)<r<xj + d(xf - ® t x ) 

- d(x? - xl)<r<x + d(x? - xl) 

The children points will be calculated as follows, 

y\ = + (1 + Cz d)x* (2 20) 

(2 21 ) 


y\ = (1 + (id)x l t - Cz dx 2 t 



c, is A landom numbei following a triangular probability distribution assuming x\<x 2 Since this 
>pei atoi is geneiating points using a triangular probability distribution so it has moic piobabihtv of 
generating childien near parents (Figure 2 13) 



Figure 2 13 Fuzzy Recombination Operator d = 0 5 

BLX-cv-/3 (Eshelman, Mathias, Schaffer, 1997) 

This ciossovei operator is again of two types - 

1 Box-BLX 

2 Dnectional BLX 

1 Box-BLX Box-BLX is of two types These are “Pairwise Recombination” and “Pool-wise 
Recombination” 

In Pan wise Recombination Operator” the children points are generated by randomly choosing 
points fiom the discretized interval \x\ — al u x 2 + /3 /,] if x 1 is having better fitness than x 2 So if 
the problem contains n parameters, the offspring will be chosen randomly from the hyper rectangle 
defined by n intervals Here I t is x 2 — x\ A 2-D case is shown m Figure 2 8 

The ‘Pool-wise operator” is different from the pairwise operator m that the parents are lan- 
domly chosen from the pool of values of different components of vector i e for % ih component two 
paients will recombine and for j th two different parents may recombine here (i,j) 6(1 2 n) 
Mathematically the recombination can b expressed for both of the above cases as 

(2 22 ) 


v * = ( 1 - + & 2 



£ is the uniformly generated random number from the range (— a, 1 + /3) & and (3 aie usei defined 
constants In case of “Pairwise Recombination” V* = 1,2, n two parents lecombme In case of 
Pool-wise Recombination” two different parents are chosen for eveiy l = 1,2 n 



Figure 2 14 Box BLX-a-/3 


2 


Directional BLX In this case the hyper rectangle is trimmed b> a factoi of 74 m each 
dnection and the offspring is randomly chosen from this trimmed hype 1 rectangle (Figure 2 9) 



Figuie 2 15 Directional BLX-a-/3, The children are uniformly randomly selected from the trimmed 
m tangle 


Simulated Binary Crossover (Deb et.al , 1995) 

This opeiatoi simulates the working of binary single point crossover It works without the coding of the 
piobleni paiameters 1 e on real numbers To achieve that the search power of the crossover opeiator 
is defined 111 terms of the probability distribution of any child string to be created from any two given 
paient stnngs The SBX has the search power similar to that of the single point, ciossovei Heie 


OO 





a paiametei called “spread factor’ , denoted by is defined Based on this parameter the ciossovei 
opeiatoi can be of three types Operators having < 1 are called contracting operators and those 
having ft>l are called expanding operators The operators having /? = 1 are termed as stationary 
operators The random variate /3 is generated using the polynomial distribution (Figure 2 10) as below 

PW) = 0 5(77 + 1)^, for /?< 1 (2 23) 

p(/3) = 0 5(77 + 1)-^, for /3> 1 (2 24) 

The value of “spread factoi is calculated by equating the area given by a randomly geneiated 

landom numbei between 0 and 1 to above equations Here 77 is the distribution index of the probability 

* 

distribution After calculating /3 from above equations the children points are generated as 

y\ = 0 5 [(1 + A)*J + (1 - A)^ 2 ] (2 25) 


Vi = 0 5 [(1 - Pi)xl + (1 + (2 26) 


ZS 

X 



Figure 2 16 SBX Crossover Operator Probability Distribution for the generation of Children 



Here f3 t is defined as /3 t = | ~Vz~V I The spread factor is randomly generated from a polynomial 
distribution defined above for each variable m case of Variable by variable” crossover 

The (3 is generated by transformation of above polynomial distribution using uniform variate as 
follows 

0(n) = { (2u)5il ' , 'M0,1)<0S (227) 

[ [2(1 — u)) 1+ 1 , if u(0, 1) > 0 5 

u is a umfoimly geneiated random number between 0 and 1 



Iii case of multi-variable problems, the crossover is done “variable by variable” i e foi a variable the 
( lossover will take place with a probability 0 5 If the crossover is to be done the value of ft is calculated 
using above equations 

The characteristic of the SBX operator is that it generated offsprings depending on the position of 
tin' patents If the parents are far, the children solutions are created far away and if the patents aie 
c lose the children are generated close Also a small value of the distribution index creates points fai 
away while a larger value gives closer solutions 

Simulated binary crossover for problems having no bounds on the variables has been described above 
If the pioblem parameters have bounds, SBX can be used after some modification In this case the area 
of the probability distribution which lies outside the bounds is added to that is enclosed by the bounds 
Mathematically it is done as follows, , 


j (ua) , if u < £ 

^ \ (5^5) ” +1 > otherwise 

wheie a = 2 — and /3 is calculated as 

2 

P = 1 -t rmn [(aq - x {) , (x u - 2:2)] 

3?2 vC 1 

Heie, Tj and x u are the lower and upper bounds on the parameter x 

2.1.4 Multi Parent Recombination 


(2 28) 


In Multi Parent Recombination more than two parents take part in recombination Let M be the 
inunbei of parents taking part in recombination Let x k = {x\. x^-, s*) represents the parent vector 

wheie A is counter running from 1 to M Let j be a counter running from 1 to n n is the numbei of 
variables The different multi parent recombination operators are presented below - 

Ummodal Normal Distribution Crossover (Ono and Kobayashi, 1997) 

Fins opeiatoi uses three parents to create two offsprings Let x x ,x 2 and x 3 be the parents & y 1 and 
y 2 be the offsprings Here x k and y k represents n-dimensional vectois 

The offsprings are generated by using the normal distribution which is defined by three parents 
Two different normal distribution are used, one is along the line connecting first two parents 1 e x 1 
and x 2 whose standard deviation is proportional to the distance between the two parents The otlrei 
one is along the line connecting third parent and the line defined by first two parents and the sta miaul 
demotion of this distribution is proportional to the perpendicular distance of third parent from the line 
defined by first, two parents (Frgure 2 11) 

Mathematically the procedure is described below - 




Figure 2 17 UNDX Operator 


y 1 =x p + £d + ( 2 29 ) 

y 2 = x p - £d - k ( 2 3( ^ 

where, x p is the mean vector of first two parents 1 e 0 5(x x + x 2 ), £ is the landomly generated 
nuiiiboi following normal distribution 7V(0, cr|), r} 3 are (n - 1) randomly generated numbers following 
normal distribution 1V(0, cr 2 ), d is the difference vector of x 1 and x 2 le (x 2 - x 1 ) and e; aie (n - 1) 
oithonoimal bases that span subspace perpendicular to formed by first two paients and follow e } 1 ei 
wlieie (j, Z)€( 1, 2, n - 1) and j^l 

This operator generates offspring which are symmetrically placed with respect to the mean of first 
two paients 

Multi Parental Ummodal Normal Distribution Crossover (Kita, Ono and Kobayashi, 1999) 

This ciossovei operator is an extension of three parental UNDX Here any number of paients between 
2 and n + 1 can participate m the crossover 

Hoie m paients take part m crossover and two children are generated The children points aie 
geueiated as below, 

1 Choose m + 2 parents randomly from the population Let these be x 1 , x 2 x m+2 

2 Calculate the centre of mass of first m + 1 parents as 

1 v -^!=m+ 1 

Xp = > X 

p m + l "*— '*=1 

Cak ulate the difference vector of x 1 and x p as, 

d 1 = x 1 - x p 



1 Let D be the length of component of d m+2 = x m+2 — x p orthogonal to d 1 , d 2 , d m+1 

4 Let e 1 , e 2 , e n ~ m be the orthonormal bases of the subspace orthogonal to the subspace spanned 
by d 1 d 2 , d m+1 

5 Generate the children points as follows, 

< 23i » 

y’=*,-EL &d‘-E;:> ije ‘ < 232 > 

Hcue ^ and % are the randomly generated number following the normal distributions N(0 and 
N ( 0 cr 2 ) lespectively 

Simplex Crossover (Tsutsui et.al 1999) 

The simplex crossover operator (SPX) creates a single offspring from n + 1 parents Here n is the 
numbei of vanables In the crossover operation these n + 1 parents form a simplex This simplex is 
extended by a factor of e with respect to the centre of mass of the parents The child is cieated by 
landomly and uniformly picking the point from this extended simplex The pioceduie of creating the 
child is described below, 

1 Choose n + 1 parents from the parental population randomly Let the parents be x°,x 2 , ,x n 

2 Calculate the centre of mass of the parents chosen above as, 

*p = yTTE>’ 

3 Geneiate r&, which is random number given by, 

r k = (u(0, 1)) E+i foi k = 0, , n — 1 

Heie w(0 1) is uniformly generated random number between 0 and 1 

4 Calculate Xk and Ck as below, 

X k = x p + e (x k - x p ) 

_ _ f 0 for k = 0 

k ~ l r k _i(X k _! - X k + C k -i) fox k = 1, ,n 

wlieie f is the expansion rate 

5 An offspung is given by, 

O — X n + C n (2 31) 


The woiking of SPX operator is shown m figure 2 18 for a 2-dimensional case 




Figure 2 18 The SPX Operator The children points are chosen from within the extended simplex 

* 

2 15 Mutation Operators 

Although we have not analyzed the mutation operators here, we describe a few commonly used m the 
following 

Lot x = (x\,X 2 , x t , x n ) be an individual where n is numbei of parameteis x , represents the 
i"‘ variable to be mutated and x[ be the mutated gene The different mutation operatois are piesented 
below. 

Random Mutation (Michalewicz, 1992) 

Hcie is a uniformly generated random number from the range [a u b z ] where a t and b, aie the lowoi 
and upper bounds on the i th variable 

Non-uniform Mutation (Michalewicz, 1992) 

Lot q be the number of generation at which the mutation is to be carried out and g rnax be the maximum 
number of generations, the mutated variable is given by, 

, = f Xl + A (g, b t -x t ) if r = 0 
1 \ x t - A(g,x z - o t ) if r = 1 

Hoie r is a landom number which may have a value of zero oi one and the opeiatoi A is defined as 

A (g,y) = y(\~ 

H(uo r is uniformly generated number from the range (0,1) and b is a parametei chosen by the 
usoi that determines the dependency on the number of iterations This function gives a value m the 

lango [0, xj] such that the probability of returning a number close to zero increases as the algonthm 

advaiK es The size of gene generation interval should become smaller with the numbei of generations 


This property causes thrs operator to make a unrform search m the rnrtial space when g rs small and 
v in y lor ally at a later stage 

Real Number Creep (Davis, 1991) 

In lias operator the chromosome is made to slide into a value which increases or decreases it by a small 
random quantity This is advantageous in case the individual is near some maxima or minima The 
maximum slide allowed is determined by a parameter set by user Different instances of this operatoi 
have been proposed, such as Guaranteed Big Creep and Guaranteed Little Creep (Davis, 1989) and 
small cieep and large creep The difference between these operators lies m the value of the maximum 
slide allowed 

Muhlenbem’s Mutation (Mulenbem et. al., 1993) ' 

The mutated gene is given as 


x[ — x 1 ±rang l j (2 35) 

wlicie r ang, defines the mutation range and it is normally set to 0 1(6, — a,) The + oi - sign is 
c hosen with a probability 0 5 and 7 is defined as 




Heie o',€(0, 1) is randomly generated with probability of yg 


Discrete Modal Mutation (Voigt et.al., 1994) 


Tins is a generalization of the above operator It differs only in the value of 7 which is given by following 
equation 


7 




with 7 r = Bm > 1 is a parameter called the base of the mutation and rang,,,,,, is the 

lowei limit of the relative mutation range 


Continuous Modal Mutation (Voigt et.al., 1994) 

This opeiatoi is also same as Muhlenbein’s operator with the difference m the 7 , given as 

t = EL o“^ ( s ™) 

D k dA- + I __ f>k 

(piz^) is a triangular distribution with — w —. 3 - — - < Zfc < ™ 2 — 



Performance Factor 


Figure 2 19 Probability distribution for creating a mutated value for continuous variables 


Deb’s Mutation 

In tins mutation operator the current value of the variable is changed to a neighboring value using a 
polynomial distribution having its mean at current value (Fig 2 13) and its variance as a function of 
the distribution index r] To perform the mutation a perturbance factor 8 is defined as 

5= C -p- 

&max 

line A //uu is a fixed quantity, representing the maximum permissible perturbance in the parent value 
p and c is the mutated value Similar to the simulated binary crossover operator proposed by Deb the 
mutated value is calculated with a probability distribution that depends on the perturbance factor 8 
and is given as 


p(5)=:0 5(7] + l)(l-idi) 7? 

The above probability distribution is valid m the range d€( — 1 1) 

To create a mutated value, a random number u is generated m the range (0 1) Thereafter the 
following equation can be used to calculate the perturbance factor 8 corresponding to v using the above 
(list nbution, 

J. /(*“)*-! ^ ,f “ £ ° 5 (2 ‘Jf>) 

t 1 - [2(1 — u)]'> +1 , otheiwise 




heieaftei, the mutated value is calculated as follows, 


C — p + <5 A max 

! 2 Variants of Real-coded Genetic Algorithm 

n this section some RCGAs are described which are some modification of the original real-coded genetic 
ilgoiitlnn The different algorithms are as follows 

l 2 1 Genetic Adaptive Search (GeneAS), (Deb et al , 1996) 

flic lmiAiy coded genetic algorithm (BCG A) discretizes the search space according to string length 
hosen to represent the problem vector i e accuracy required On the other hand the real-coded genetic 
ilgoiitlim (RCGA) work with the representation of problem vector using real numbers The BCG A 
lms discietizes the search space even if the search space is continuous The RCGAs in solving problems 
Inning discrete search space (in the case of zero-one or discrete variables), assume the search space to 
be continuous and then introduce artificial constraints to favor permissible discrete values 

The GeneAS combines both of these algorithms Here a mixed coding scheme is used to code all 
zeio-one and disciete variables in binary strings and the continuous variables aie coded dnectly The 
(lifieient components of GeneAS are stated below, 

Coding 

The pioblem parameters m the parameter vector are coded in either binary strings or directly depending 
on the type of the variable A zero-one variable is coded in a one bit (Oorl) sub-string A discrete vai lable 
is c oded m eithei bmaiy string or directly represented by real numbei depending on whether the total 
munbei of peimissible choices for the variable is 2 k or not A continuous variable is coded dnectly A 
typical individual with this coding scheme would be, 

(1) 15 23 457 (1011) 

The fiist variable is zero one type, second and third one are continuous and the last one is a disci oto 
\ai lable 

Selection 

The selection operator works same as m the simple genetic algorithms i e the individual having inoie 
fit ness is selec ted to be placed in the mating generation Since this operator only depends on the fitness 
of the solutions, a standard proportionate, ranking or tournament selection can be used 



Crossover 


Hc>ie the cxossover is being done variable by variable and a variable is ciossed with a piobability 0 5 If 

1 he vanable to be crossed is coded in binary string, a binary ciossover operator is applied On the othoi 
hand if the vanable is coded directly a real coded crossovei operator as simulated binary crossover 
(SDX) is used 

Mutation 

Aftei the crossover operator is used with a small probability If the variable selected foi the mutation 
is a binary string, a random bit is changed from 1 to 0 or vice-versa For the continuous vanable the 
r in lent value of the variable is changed to a neighboring value using a polynomial distribution having its 
moan at the cui rent value and its variance as a function of the distribution index n as stated above If 
t he c lioson vanable is discrete it is changed to a neighboring permissible value with a discrete probability 
distribution 

2 2 2 BUGS (Iba et aL, 1993) 

Another algorithm that implements the real coding and uses the concept of the RCGA is BUGS proposed 
In Iba The main features in which this algorithm differs from the conventional RCGA are as follows 

1 The first mam difference is m the contents of the individuals In a conventional RCGA an individ- 
ual is a collections of the values of problem parameters In this algorithm the population consists 
of structures called bugs which are characterized as. 

Position x l (g) = (x\(g) ~x l n {g)) 

Direction dx l (<?) = (dx\(g), ,dx l n (g)) (2 37) 

Energy e\g) 

to population size, n is the number of parameter and the eneigy 

e . = ~ fc )) ( 2 38 ) 

The above equation gives the cumulative sum of the fitness of the positions in the bugs, over the 
pievious t v time steps generations, where t u is an input parameter The position at generation g 
aie updated as 


bugs l (g) = | 

Here i is a counter running from 1 
of the i th bugs is defined as 


x'(g A 1) = x l (g) + d x‘(g) 





2 In a conventional RCGA , the fitness of an individual is taken to be the objective function value 
at that particular point, here the fitness of a bugs is defined as the energy of the bugs 1 e a bug s 
having more energy is considered to be more fit 

j Anothei difference is m the application of the crossover and mutation operators The ciossover 
and mutation operators in this algorithm act on the direction component of a bugs instead of the 
position as is done m a RCGA 

The steps in the algorithm are described below 

1 Generate an initial population at random 

Pop( 0) = (bugsi(0), ,6U5S M ( 0 )) 

Input r„ and set g = 1 Here p is the population size 

2 Foi / = 1, 2 p, do 


x‘($ + 1) = x l (p) + dx'O) 


i Foi / = 1 2, mu , do 


e‘0) = e 1 ^ - 1) +x 1 (g) 


4 If q is a multiple of r u , then 

• Set m = 1 

• Select two parents bugs t (g) and bugs,(g) using a probability distribution over the energies ol 
all the bugs m Pop(g) so that bugs with higher energy are selected more frequently 

• With probability p c apply the crossover operator to the dx*(g) and dx J (</) forming two 
offspi mgs bugs m (g 4- 1) and bugs m+1 (g ) in Pop(g + 1) 

• Apply the mutation operator to dx‘(g) and dx J (<?) with probability p m 

• set rc = n + 2 

• if r! < N. goto step 2 

5 If g is not a multiple of t u then 


Pop(g + 1) = Pop{g) 



• g -9 + 1 

• goto step 2 

6 Foi / = 1 2 fj, do e‘(p) = 0 

• 9 = 9 + 1 

• goto step 2 

2.3 Evolution Strategies 

The evolution strategies were first introduced by Schwefel and Rechemberg The fiist ES was a two 
menibeied algonthm which worked by creating one n-dimensional vector of object vanables fiom its 
paient by applying mutation with identical standard deviations to each object variable This simple ES 
is toimed as (l-tT)-ES The first multi-membered is# or (/z + 1)-ES was designed by Rechemberg In tins 
algonthm fj paients recombine to give one offspring which after mutation replaces the worst paient if 
t he offspring is better This introduced the concept of population m evolution strategies Later on 111010 
offic lent ESs weie introduced by Schwefel These include (fi + A)-ES and (/i, A)-ES In both of these' // 
paients lecombme to give A offsprings In the former algorithm the after mutation next generation is 
formed by choosing fj, best individuals from the union of parents and offsprings while m the latei after 
mutation ji best offsprings form the next generation (1 e A > [i is necessary) 

Tlieie aie two major differences between real-coded genetic algorithms and evolution strategies as 
follows 

1 In RCGA the crossover operator is the mam search operator while m ES the mutation opeiatoi 
is the mam search operator and crossover works as a secondary operator 

2 In RCGA the object vector consists only of the problem parameter while m a ES the object vai lable 
uu hides pioblem parameters as well as standard deviations also termed as mutation strength and 
lot at ion angles 

The mam features of the ES are described below, 

2 3 1 Representation 

In ES the object variable component a consists of the problem parameter vector x and strategy pa- 
lameteis standard deviation vector, a and rotation angle vector a 1 e a = (a\a,5) 

Along with the object variable vector £, each individual has n a e( 1, ,n) different standard devia- 
tions a , (r = 1, n a - 1) for the normal distributions used and n a €( 0, xotation angles 



n g |_ 7ri Here n is number of problem parameters and + 1, n) So m case of 7\ a = n then' 
U1 p | JC "Of 1 ) I0 tation angles giving total strategy parameters to be In case 1 < ri„ < n the 

standard deviations cr h a na -i are coupled with object variables xu x na -i and c Ua is used foi the 
lomammg vanables 

The' numbei of lotation angles depends on the n a , the number of standard deviations and n but if 
( an also be explicitly set to zero indicating that this strategy parameter part of the individuals is not 
list'd The ES without this strategy parameter is called the uncorrelated ES while one involving this 
paiametei is known to be correlated ES 

2 3 2 Mutation 

As aheady pointed out that mutation is the mam search operator m the working of an evolution stiategi 
flic mutation is applied to an individual a as follows, 


exp (r' N{ 0, 1) + r N t ( 0, 1)) 

(2 39) 

ce'j — cnj + /3 7Vj(0, 1) 

(2 40) 

' = S + N(0, C{a',a')) 

(2 41) 


The above equations hold (V*€{1, n}, V?€{1, n (n - l)/2}) N{ 0,1) is the realization of a 

noimally distributed one-dimensional random number having mean zero and standard deviation one 
V,(() 1) indicates that the random number is sampled anew for each value of % Similarly N } (0 1) is 
sampled anew foi each possible value of j a[, o' and S' denote the values of mutated standaid deviation 
mutated rotation angles and mutated value of problem parameter vector respectively 

Multiplication by such a matrix performs a coordinate transformation with respect to axes numbei 
/ and j and angle a tJ Since n a rotations are needed to represent all correlations, the complete relation 
between <r c and a u results as 


^ = (n;:;n; t+1 R K)) 

The factors r, r' and / 3 are other parameters of which the values are suggested as 



(2 42) 


t'cx [ V 2 nJ 



/3 = 0 0873 


Usually, the values of proportionality constants for the r and r' are taken as one and the value of /I 
is suggested to be 5° 

2 3 3 Recombination 

The lecombmation in evolutionary strategies can be done using any of the following opeiatois which 
aie in use These are, 

• Discrete Recombination 

• Intermediate Recombination 

• Geneialized Intermediate Recombination 

Each of the above operators can be of sexual or panmictic form In the sexual form the recombination 
opeiatois act on two individuals randomly chosen from the population In the panmictic foim one parent 
is kept fixed while for each parameter of the parameter vector the other parent is chosen randomly horn 
(lie population 

The different operators used are used below, 

Discrete Recombination 

In discrete lecombmation, for each component of the vectors it is decided at random from which of 
the both paients (m sexual form) the component is copied to the offspring individual The panmictic 
\aiiant chooses for each component a new parent individual from the whole population 

Intermediate Recombination 

Intermediate recombination indicates that the offspring’s components are obtained by calculating the 
ai ltlnnetic mean of the corresponding components of both parents Foi the panmictic version one parent 
is kept fixed while for each component the other parent is chosen at random fiom the population 

Generalized Intermediate Recombination 

In this opeiatoi the recombination is done using arbitrary weight factors fionr the range [0 1] besides 
t lie value 0 5 as used m intermediate recombination 


Mathematically all these operators can be stated as follows, 



Lot i\ and X 2 be two parents chosen for recombination and x f be the offspring vectoi then V? = 


1 n 


x\, L or X 2 , t discrete 

xi it or X 2 , tl panmictic discrete 

x it + & intermediate 

i — — \ 5 ^ 

xi t t + - '* 2 1,1 panmictic intermediate 

xi, t + x( x 2 ,i ~ xi, t ) generalized intermediate 

x i,i + x( x 2 ,i t — x i,t) panmictic generalized intermediate 

Here i 2,1, indicates that the second parent is to be sampled anew for each value of the i 
2 3 4 Selection 

The selection m the evolution strategies is totally deterministic The evolution strategies are represented 
In notations like (p+A)-ES, (p, A)-ES The former selects best p individuals from the union of the patents 
and (lnldien The later shows that best p offsprings will be selected from the A offsprings 

Combining the different steps as discussed above the algorithm for a (p + A)-ES and a (p A)-ES can 
be written as 


1 Set generation number counter g = 0 

2 Randomly initialize the initial population, P(0) = {oi(0), ,0^(0)} Here a = (x, a a) 

3 evaluate the fitness of the individuals fitness = <p(a) 

4 lecombine, mutate and evaluate the fitness of the individuals 

5 select the p individuals according to strategy used 

6 if max(^(a))-min($(a)) < e terminate 
else set g=g+l and goto step 4 

Heie p denotes the population size 
2.3.5 Invariance Property of Evolution Strategies 

Recently concept of invariance has been proposed by Nikolaus Hansen (2000) to evaluate the peifoi- 
maiK e of the evolution strategies The invariance concept tries to explore the self adaptive power of the' 
ES by finding a certain ES performs similarly in transformed problem space or by achieving invariant e 
against oeitam tiansformation of the search space Starting from the best strategy parameter setting, 
with adaptation tuned on the invariance ensures a predictable behaviour of the strategy In the following 
the' miHinavce concept is described and the invariance properties of certain algorithm are discussed 



Invaiiance properties of a search algorithm with respect to changes of the objective function aie ex- 
tiemely attractive They raise the probability to get the similar or even identical results on similar not 
yet evaluated objective functions and increase the predictability of the strategy behaviour Mainly the 
in van Anee against the following changes are desirable, 

1 Translation On f x\ ->q(x - a) invariance against a€i? This presents the invariance against 
the linear transformation of any dimension by a constant value 1 e if the objective function is 
linear ly transformed the algorithm should perform similarly as on the untransformed function 

2 Rotation On f x e-)- q(Ux) invariance against the orthogonal matrix U This means the 
invariance against the chosen (orthonormal) coordinate system and includes the invariance against 
the rotation and reflection of the search space 

Heie q is chosen arbitrarily The invariance can be lost if more complex operators are introduced m 
i lie simple ES 

It a certain ES is able to preserve its performance, it is considered to be good algorithm Hansen 
analyzed the (1 + A)-ES against the linear and rotational transformations He used the sphere model 
and its linearly transformed problems and the problems obtained using a orthonormal matrix to test 
against the lotation He found the (1 + A) was not able to perform m the same manner as m the 
untiansformed case i e this ES was not able to retain these invariances and also the performance was 
too much dependent on the initial guess so a good guess initial guess is also important 

The concept of invariance can be extended to other ESs as well as to other algorithms 

2.4 Differential Evolution 

Difieiential Evolution was proposed by Price and Storn (1997) In DE also there are selection crossovei 
and mutation but these are different from that m the genetic algorithm oi evolution strategy The 
woikmg of DE and its different components are described m the following, 

The parallel version of DE holds two arrays each of which hold a population of size p, n-dimensional 
leal valued vector One array named as primary array holds the current vector population while the 
se< ondaiy anay contains the vectors which are selected for the next generation 

In each generation p competition are held to determine the next generation The fitness hoio is 
I euiied as cost which is nothing but the objective function value at that particular point 01 individual 
In all the DE depends on the three factors namely, the population size,p, the weight applied to the' 
landom differential, F, and the constant that mediates the crossover operation, CR The steps m the 
difieiential evolution are described below, 



2 4 1 Initialization 


Ea< h paiametei in evexy pnmaiy array vector is initialized with a uniformly distributed landoni value' 
I>< i worn the bounds on the variables To determine and preserve the cost 1 e fitness of the insulting 
nut nil population, each primary array vector is evaluated and the results are stored in the anay cost [] 

2.4 2 Mutation 

The mutation m the differential evolution is carried out by perturbing a randomly selected vectoi fiom 

1 lio population by adding the difference between two other randomly selected vectors (the diffeience lias 
boon t eiined as the “vector differential”) Therefore if the vector X c has been selected foi the mutation 
two othei vectors X a and Xb are selected from the population and the vector differential is given by 
V„ — Xb If the mutated vector is represented by X' c , the mutation is given as 

X' c = X C + F (X 0 -X b ) (2 43) 

Hoie F is the user specified weight applied to the random differential The value of F lies m the 
lange (0 1 2) 

2 4 3 Recombination 

Ro< ombmation m DE is done using the non-uniform crossover Each primary vector (called the taiget 
vc'c toi ' ) is to undergo the crossover with another randomly chosen vector Let X z be the chosen taiget 
vecloi and X[ be the another parent which has been chosen randomly from rest of the population foi 
mating with the target vector The randomly chosen vector is recombine the target vectoi aftei the 
i andomly chosen vector has been mutated Which parameter of the target vector or of randomly chosen 
v('( toi will foim the offspring vector is determined as follows, 

Staiting fiom a randomly selected parameter out of the n parameters for every parameter a unifoimly 
geneiated landom number between 0 and 1 is created and it is compared with the value of constant 
C R (0<Ci?<l), if the value of CR is less than the number created, the taiget vectoi will form that 
paiametei of the child else the randomly chosen vector will foim that parameter of the child When 
CR = 1 eveiy parameter of the child vector will come from the randomly chosen vectoi On the othei 
baud if CR = 1, all but one child vector parameter comes from the target vectoi To ensuie that the 
< ln Id vectoi is not same as target vector the last parameter always comes from the i andomly chosen 

V('( t Ol 

2.4 4 Selection 

DE does not use any proportional selection, ranking for the selection Instead the cost of each trial 



vo( 1 01 is compared with its parent target vector The vector with the lower cost is allowed to advance 
(o (he secondaiy ariay so as to form the population for the next generation In addition, if the tnal 
vo< toi wins, its cost is stored in cost [ ] 

Some guidelines for choosing the values of population size, /r, the differential factor F and ciossovei 
constant have also been given by the authors as follows, 

()i dinar ily the population size ought to be about five to ten times of the number of parameters in a 
voc toi As foi F, taking the value 0 5 initially is recommended and then increase the value of F if the 
pi cunat me convergence takes place A larger value of the constant CR is recommended 

2.5 Family Competition Evolutionary Algorithm (FCEA) 

The FCEA was proposed by (Yang, Lm and Kao, 2000) This algorithm is similai to evolution strategies 
Like evolution strategies, here also the mutation is the mam search operator The mam differences fiom 
i lie ES aie 

• Thiee different mutation operators are used here sequentially to produce the children population 

• Two recombination operators have been applied to the solutions with associated probabilities 

• Two selection techniques have been used to form the next generation 

The-" basic FCEA is shown pictorially m Figure 2 14 

The working of the FCEA is as follows, 

N solutions are randomly generated as the rmtial population Then the FCEA enters the main 
evolutionary loop which consists of three similar procedures Each procedure is realized by doing 
ice ombmatioiis, mutations, family competition and selection These three procedures mainly differs m 
l lie mutations used The mutations applied are decreasing Gaussian mutation, self adaptive Cauchy 
mutation and the self adaptive Gaussian mutation This proceduie is termed as the FC adaptive 
proceduie The procedure mainly employs four parameters, namely the parent population, (P with 
N solutions), mutation operator, (M), selection method, (5), and family competition length (L), to 
genei ate a new quasi-population The procedure to generate the new quasi-population is as follows 

Eac h individual in the parent population sequentially becomes the family father With a piobabihty 
/>, this family father and another randomly selected individual recombine to give an offspring Them 
the new offspring or the family father (rf the crossover is not done) is mutated by the mutation opeiatoi 
specified Foi each family father this process is repeated L times to give L children From these L childien 
points the best one is selected Since L children are created from the family father and a selection is 
poi foi lilt'd, this is called a family competition strategy After the family competition there aie total N 




Figme 2 20 The family competition evolutionary algorithm and procedure used to do the mutation, 

1 (H ombmation and selection 

paients and N offsprings, now some selection scheme is used to generate the new quasi-population The 
selection scheme used depends on the mutation method used 

In the following sections the various features of FCEA like representation, selection, recombination 
and mutation are described 

2 5 1 Representation 

The contents of the individual here are more or less similar to that m the evolution strategies Here an 
individual is represented as the set of four n-dimensional vectors (x l , er l , v 1 , i/A), where n is the numbei 
of paiameters and i — 1,2 N The vector x is the mam variable vector to be optimized and a v and </; 
aie the step size vectors of the decreasing mutation, self adaptive Gaussian mutation and self adaptive 
C'aiuhy mutation, respectively 

2 5 2 Selection Procedures 

As destnbed earlier after family competition the selection is employed on the N parents and N offspnngs 
to (leate N individuals foi the new quasi-population The selection strategies used here aie mainly 
tournament selection” but with different foims These are as below, 














Family Selection 

In tlu> family selection scheme the child is compared with its family father and the one out of these' 
wine liovoi is bettei is selected for the quasi-population 

Population Selection 

The population selection scheme selects N individual solutions from the population foi the quasi- 
population Thus this selection is similar to the (/i + p) selection used in the tiaditional evolution 
sliategies 


Tlit' selection scheme used to form the quasi-population is dependent on the mutation opeiatois In 
( ases where Gaussian or Cauchy self-adaptive mutations are used in the FC adaptive proceduies the 
Family Selection scheme is used while m the Population Selection scheme is used m case of decreasing 
Gaussian mutation In this case the population selection is used with a probability (P — ps) and the 
family selection is used with probability (1 — P ps ) To reduce the ill effects of the gieedmess the initial 
value of P ps is set to some small value e g 0 05 Later on when the mean step size of the self-adaptive 
Gaussian mutation is larger than that of the decreasing Gaussian mutation it is changed to some laigci 
value eg 0 5 

2 5 3 Recombination 

The lecombmation in the proposed algorithms uses two operators namely modified discrete recombi- 
nation and blend crossover (BLX-0 5) The intermediate recombination which is a special case of the 
13LX-0 5 is also used These operators are used with the probabilities 0 5, 0 25 and 0 25 lespectively 
\\ cadi FC adaptive procedure only on of these operators is used to recombine with the probabilities 
mentioned befoie Here the recombination is same as that m the ES i e the recombination is done on 
pioblem variables as well as on the strategy parameters The recombination used aie stated below 

Modified Discrete Recombination 

1 lit' oiigmal disci ete recombination works by randomly choosing the genes from the two patents with 
equal patents Here this operator is modified so that the genes have higher probability to get selec ted 
hum the “family father” The modified operator is as 

c _ J with probability 0 8 
3 \ x~ with probability 0 2 

Hoio a b and c are family father, some randomly chosen vectoi and the child respectively j<=( 1 n) 



BLX-0 5 and Intermediate Recombination 

BLX-0 5 and Intermediate recombination work as already been described m the section 1 The opeiatois 
lecombme the problem parameter vectors as well as strategy parameters 

2 5 4 Mutation 

Mutations aie the mam search operators of FCEA After recombination, a mutation opeiatoi is applied 
to each “family father” or the new offspring generated by recombination In FCEA the mutation is 
peifonned independently on each vector element of the “family father” by adding a random value with 
expectation zeio The mutation operators are described next, 

Self-Adaptive Gaussian Mutation 

The self-adaptive Gaussian mutation is accomplished by first mutating the step size v 3 and then the 
va liable r ; as 


V e j = v“exp [r'iV(0, 1) + tN 3 ( 0, 1)] 

Xj — Xj + VjNj ( 0 , 1 ) 

wheie N( 0, 1) is the randomly generated number following normal distribution with mean 0 and 
standard deviation 1 iV,(0, 1) is sampled anew for each possible value of j The constants aie t = 

(x/ 277) -1 and t' = (a/2 \/n) -1 

Self-Adaptive Cauchy Mutation 

\ landoin vanable is said to have the Cauchy distribution if it has the following density function 

t_ 

f(x,t)= for -oo < x < oo 

The mutation is pei formed as, 


= rfexp [t'N( 0 , 1 ) + tN 3 { 0 , 1 )] 


= x a 3 4- ipjCji 1) 


Th<' diffeient constants have already been defined ip is the step size used in case of self-adaptiu* 


Cam hy s mutation 



Decreasing Gaussian Mutation 


The de( leasing Gaussian mutation uses a fixed decreasing rate 7 = 0 95 to control the step size The 
mutation is done as follows, 


<y c = 7 a 0 


= + 0 , 1 ) 



Chapter 3 


Behaviour of Crossover Operators for 
Real- Coded GA 


In this chapter the analysis of different crossover operators available for real-coded genetic algonthins 
is peifoimed based on the postulates proposed by (Beyer and Deb, 1999) and the desirable properties 
oi a ( lossovei operator has been explored 

3 1 Need 

In genetic algorithms, two mam operators are reproduction (selection) and variation (crossover) opei- 
atois The function of the reproduction operator is to exploit the search space and to look for good 
legions m the search space The purpose of the variation operator is to use the parental population 
loimod after the reproduction operation to create the children population In other words, the lepio- 
(liu tion opeiator uses the information from the fitness space, whereas the variation operatoi handles the 
soak h space information Since an ideal variation operator may only process search space information 
of the selected population, the variation operator should not introduce any bias on the population level 
so the best it can do is to keep the mean of the parent population unchanged 

There are several criteria for an efficient crossover operator There are some postulates suggested by 
Beyoi and Deb (1999) for the efficient working of a crossover operator These postulates aie descnbod 
as below 

3 1.1 Postulates on Population Mean 

Postulate 1 The expected population mean should remain unchanged under the application of a crossove i 
o/x i at oi 

Since the variation (crossover) operator, in general does not use the fitness information, there is no 
leason for it to shift the population mean in any direction It is the task of reproduction operatoi to 
pi ovule the good regions to be exploited by the recombination operator In this way the best a ciossovoi 
opeiatoi can do is to keep the mean of the population intact while increasing or decreasing the variance 



oi the' population This also holds good for the standard binary GA recombination opeiatots one- 
point n-point and uniform crossover m the genotype search space as well as m the resulting phenotype 
population 

3 12 Postulates on Population Variance 

The following postulates have been proposed for the different fitness landscapes, 

Flat Fitness Landscapes 

Postulate 2 The expected population variance should exponentially increase with the generation number 
This is so as to leave the region of constant fitness as quickly as possible since there is no selective 
jii i'li'H'iu e foi these parts The best an algorithm can do under such circumstances is to randomly walk 
ilnough the search space trying larger steps 

Linear Fitness Landscapes(Hyper-plane) 

PosUdate 3 The expected population variance should exponentially increase with generation numbei 
Lmeai fitness landscape divide the search space into two sub-spaces separated by a hyper-plane 
In Evolution Strategies, considering isotropic mutations, on average each second mutation (staitmg 
hom a parental point) yields an improvement independent of the mutation strength used Howewi 
l ho laigei the mutations the larger the expected improvement Therefore, the mutation strength and 
(lie population variance, respectively should increase over the generations The same can be said for a 
leumibmation opeiatoi 

Unimodal Fitness Landscapes 

If the parental population brackets the optimum, a reduction in the variance of the population 
would serve the purpose but if it does not, a situation similar to that m case of linear fitness landscape 
aiises and an increase m the variance would be beneficial In real world problems the latter case is 
moie common because the location of the optima is not known aprion so an increase in the population 
laiiaiuo would be better 

Multi-modal Fitness Landscapes 

The mciease or decrease of the population variance should largely depend on the fitness landscape 
and the placement of the parent population It is argued that even m this case, a generic strategy 
would be to use a variation operator which increases the variance and then introduce adequate selec tion 
pi ess ui e by the reproduction operator to exploit the child population 



Time Dependent Optimum and Rapidly Changing Fitness Landscapes 

In both of these cases it may be important to increase the variance after a certain penoci of shrinking 
So the algorithm should have the ability to increase the variance of the population 

3.2 Analysis of Crossover Operators for Real-coded GAs in Flat Fit- 
ness Landscapes 

In the following the analysis of a number of crossover operators m real-coded GAs is done for fiat 
fatness landscapes Specifically, the mean and variance of the children population are derived fiom the 
known distribution of the parent population First the crossover operators which use two parents to 
geneiate two children are considered and then some multi-parental crossover operators are considered 
The theoietical results are compared with the simulations 

Rnombnwtwv Operators of a Special Type 

In most of crossover operators m real-coded GAs, the recombination is done by picking two parents and 
< mating two offspungs Since offsprings are created in pairs, we have p/2 pairs, here p is the population 
size The paned individuals are numbered 1 and 2 and are represented by an index counter k running 
horn 1 to p/2 

The lecombmation operator proposed by Deb and Agrawal (1995) called simulated binary crossovei 
(SDX) is defined as 


yi,k = 2 K 1 - Pk)xi ,k + (i + A> 2 ,fc] 


(3 1 ) 


1/2, fe = 2 [(1 + Pk) x l,k + (1 - Pk)%2,k] 


(3 2) 


Heie j.\ i and n k are independent samples from the parental population and is a sample from a 
landoin numbei generator having the density 


_ f Un + 1)/3”, if o < /3 < i 

\ M 7 ? + ^ > 1 


PiP) — { if R s> i (3-0 

This distribution can easily be obtained from a uniform random number source by the transformation 


as 


/3(u) = 


(2 u ) r >+ 1 , if u(0 1) < 0 5 

[2(1 — u)]~’i+ T , if u(0 1) > 0 5 


Boyer and Deb (1999) formulated the mean and variance of the population as follows, 


(3 4) 



D ( fwifion of Population Mean 


Tii o population moan is defined as 


^ ~ ^m=i ym ( 3 5 ) 

H('ic the subscript m is the individual counter running from 1 to population size y and (y) is the average 
oi mean of the offspring population Since the crossover operation produces two offsprings, rearranging 
above equation to 






(3 6 ) 


Definition of Populatwn Variance 

The population variance of the offspring is defined as, 

Var M = ^ELi(ym-(y» 2 (3 7) 

The' npected value of above expression will be, 

cr 2 [y] = E[Var{y}] = Var{y} (3 8) 

it depends on the expected variance of the parental population, denoted by a 2 [x] which is given by the 
following equation, 


a 2 [x] = E [(x - x) 2 ] = x 2 - x 2 (3 9) 

Cali ulatwn of the population average (y) 

Using eqns (3 1) and (3 2) in (3 6), we get 

<»> = ;;£[!>'•* + < 3 10 ) 
Thus (tossover operator represented by eqns (3 1) and (3 2) preserves the mean of the parental 
population As stated earlier, this is a desirable property of the crossover operators by Postulate 1 


Cahulation qfpopulation variance 


Pi om eqn (3 7) we can alternatively write, 



(3 11) 


Vm - <»» 2 = jEtoi - <»» 2 + - < v » 2 ] 

As is ( lcvu taking (3 1),(3 2) and (3 10) into account, the Var{y} consists of a sum over Zi yk iji pioduc ts 
Since the expected value of Vai{y} is to be determined, we have to determine the expected value of 
1,1 1 it t ci ms Since the sampling process copies the individuals at random from the paiental pool to 
the c i ossovei operator, all x l)k are independent and identically distributed Therefoie we have 




x 2 , if i = J A k = l 
x 2 , otherwise 


(3 12) 


vlieie i and x 2 aie the first and second moments respectively, of the parental population distnbution 
In oidei to calculate the expectation of (3 11), the square brackets in (3 11) must be rearranged in such 
a wa\ that the products x ttk x J<t are separated from the rest This can be done as follows, 

Beyoi and Deb (1999) found the following variance evolution equation for above type of a ossovei 
opeiatms as follows 


a 2( 5 +i) _ I ^ 1 “ ~ + J® 2 ) a%) ( 3 13) 

By lecimence, the equation of expected variance dynamics can be written as, 

* b] (S) = [v] (0) - 1 + f y (3 14) 

lui the dcuvation of the above equation, see Appendix A 

It is c leai fioin above equation that there is an exponential change in the population variance with 
genei at ion numbei g 

3 2 1 Determination of Variance Evolution Equation for Different Crossover Oper- 
ator 

In this section value of /3 2 for different crossover operators will be evaluated and the variance evolution 
('(Hiation will be obtained Beyer and Deb (1999) obtained the variance evolution equation foi SBX 
13 LX and FR ciossover operators which is also presented m the following and the evolution equation foi 
othei opeiators is also determined The evolution equation (3 14) contains the term /3 2 which depends 
on the landom number distribution used Its value is given as 

W = I /3 2 p(P)dl3 (3 15) 

The \ nuance evolution equation for different crossover operators is obtained as below. 


SBX-n 



Ill (dsc of SBX the standaid WAV to geiHUcitc ^ IS by tiAnsfoimatiA f f 

111 v &loima won from the uniform variate u( 0 ,i) 

Tims we can lewnte eqn (3 l> r i) as 


/"~i 

= UU")) 2 du 

J uz 


-0 


(3 16) 


Using eqn (3 1) and eqn (3 16), we anivo at 






«= 0 


(2it) i+* du •+■ 


/ , [ 2 (1 - 

t U - „ 


«)] i+i du 


(3 17) 


Making substitution a = 2« m the first integral and / = 2(1 - u ) m the second integial we ge, 
following equation foi rj ^ 1 


p-\ 

w hi( h on substitution gives 


l + -2_ 
^ T/+1 


5 ( 1+ i+i) 


i l 




1 t (^ 


i _ jl 

i+i 


n+i ; 


Jo 


(3 18) 


/? 2 1 


7/4 1 T/ + 1 

— 


2 [?/ + 3 r/ - 1 


simplifying the equation we get, 


P 2 = 


0/4 l ) 2 


(77 4- 3) ( 7 / — 1) 


Using eqn (3 20) m eqn (3 14), we have 


M l9> = <+■ b,]<°» A + 


(3 19) 


(3 20) 


( 7 / 4 - 3) (77 - 1 ) n) ^ 321 ) 

Above equation gives the variance dynamics m < ase of SBX crossover operator It holds good 

foi // > 1 As is clear from the equation the expected population variance depends on the value of 
'I Parameter 111 case of SBX for a given population size /r From the above expression we can easily 
detmnme the value of parameter r] for which the population variance will increase for a given population 

Size' 

Foi vein 


nance to increase, the terms withm large parenthesis should be greater than one Doing 


so wo 


■•pi 


A* > 2 (V 4- 3) (77 - 1) (3 22) 

Thus foi a particular 77, the population size fi should be greater than the above value for expec ted 
population variance to increase 


BL\- a 



In case of BLX-o wo < o two offsprings as given m section 2 11, comparison with eqns (3 1) and 
( J 2) yields /i — -i. ' * H«ue £ is a uniformly generated random number in the range [-a, 1 + o] so 
the piobalnlity distillation v, dl b c p (() = ^ From eqn (3 15) we have, 


d 2 


/*C=l+ot 

1 + 2 aj t-- a 


£= 

1 +=l-)-a 

“T+to/^ < 4£ ' 4{ + 1) ^ 

1-fa 


(2£ — l) 2 d£ 


1 


1 + 2a 


r - w + i 


i huh on simplifu at ion viokls 


/?2 = I(2a+l) 2 (3 23) 

O 

Using above oqu.it ion in <>qn (3 14), we get the variance evolution equation for BLX as 

rr“ [7]^ = a 2 [y]^ ^1 + - (2a 2 + 2a — l) — — ^ (3 24) 

Again it is deal hum ul >< jvo equation that the population variance increases or decreases, it depends 
on the population si/o iui ;i {given value of parameter a which means there will be certain value of 
population size toi a given value of a over which the population variance will increase and at this 
paituulai value of population size the convergent and divergent will be balanced 

Tins minimum value of population size which gives diverging population can be determined by putting 
twins inside bia< kefs gi eat <»i than 1 of eqn (3 24) This gives us 


M > 


3 

2a + 2a 2 - 1 


(3 25) 


EM 

Iu fay lecombmat,,,,. operator suggested by Voigt et al (1995) two offsprings are cieated usmg a 
tin,. 6 „U, probability .list.ibut.on as described m section 2 1 1, the eqn (3 15) can be written m tins 


( as(' as 



Hwe c, is a randomly generated 
distribution is given as 


number following a triangular distribution and the probability 

‘so- f o 5frr?r<Tt5 



p( 0 = 


/ C + 1 for -1 < c, < 0 

\ 1 - C for 0 < ( < 1 (3 26) 

Comparison of equations foi offspimgs in case of FR as given in section 2 11 with oqns (3 1) and 
(3 2) yields the value of (3 foi FR to be 1 + 2 (d Using this value 0 and eqn (3 26) in (3 15) we have 

— f C=0 ? f C=1 

P 2 = (l+2(d) 2 (C + l)dC+ / (l + 2Cd) 2 (l - C)dC 

' (=-i i <=o 

which on mtegiation gives 

P 2 = 1 + ^d 2 (3 27) 

substituting this value of 0 2 in equation (3 14), we get variance dynamics foi the FR opeiatoi as 

a 1 [y] (s) = a 2 [y] (0) ^1 + irf 2 - (3 28) 

In this case too, by the same argument we can obtain the value of population size for a given value 
of d foi which the expected population variance will increase This will give us following value of 
population size 


A* 



(3 29) 


Fhjf Cio^ovei 

Tins c lossovei operator is same as the BLX-0 0, thus we can write the variance evolution equation foi 
it by putting a = 0 m eqn (3 24) as 

® J M <,) -" ! “(y] <0) (§-!)' (3 JO) 

It is clear from above equation that this operator reduces the variance of the population independent 
of the population size 

AjjJjjmtiical Cvossover 

'I’lns opeiatoi produces offsprings as described m section 2 1 1, the parameter A is used to aeate 
< liilchen Compaiison of expressions for offsprings with (3 1) and (3 2) gives value of /3 as 2A — 1 which 
is a c onstant, therefore the probability density function for the parameter 0 would be unity Now using 
(3 15) we have 


0 2 - (2A - l) 2 


(3 31) 



Substituting m (3 14), we get 


<? 2 [yJ (9) =* 2 [y] (0) (\ + 2A(A - 1) - * (3 32) 

Pi oni the above equation, it is obvious that any value of A < 1 will reduce the variance of the 
population mespective of the population size p, 

Foi values of A > 1, the variance will increase when the population size will follow the following equation 

^nihr) < 3 33 > 


Ertendecl Lme and Extended Intermediate Crossover 

Both these ciossovei operators aie same as BLX-0 25, the variance evolution equation can be wntten 
In substituting rv = 0 25 m (3 24) It will be as below, 

a 2 [y} [9) = a 2 [yf ] Q - ^ (3 34 ) 

As one c an see that the population variance will decrease irrespective of the population size chosen 

The analysis for the evolution of variance has been done above for the operators which geneiate 
I wo dnldien fiom two parents In the following other crossover operators like UNDX and SPX will be 
(onsideied Fust. UNDX has been considered 


Ummodal Normal Distribution Crossover: 

Tin* UNDX geneiated offsprings using three parents and two normal distributions, one along the line 
(ouiiei ting first two parents and the other one along the line which is normal to the lme connecting hist 
two paients The children points are generated as follows 

y 1 = x p + £d + £;> ek 

y 2 = x P - £d - Yl J= i^ Dek 

Previous Work: 

Kita et al (1998) have done the analysis for the UNDX operator for mean preservation and covanaiue 
pioseivation in infinite population Their findings are stated in the following, 



Mm- Fl0m tho l>quahon o{ the chlld solution above m UNDX opeiator taking expected value of the 

('XplCSSlOll YK'lcis 

< yl > =(*P+fd + E;i‘l J De k ) 

= (x p ) + (£) (d) + (rj) (e k D) 

—< x p > 

= g(< X 1 > + < X 2 >) 

< y 1 > = x 

It shows that the UNDX operator preserves mean for infinite population 

Comi IMO L Fo1 ,he ( ovanance analysis, they considered only the parallel component of the aossovei 
opoiatoi Th(> equation they got is as below, 



(3 35) 


It can bo seen fiom the above equation that the covariance matux of the population can expand 01 
< out 1 act depending upon the value of the constant 

Analysis of UNDX operator for finite population- 

In the following the UNDX will be checked for postulate lie mean pieservation and postulate 2 l e 
variance dynamic s 1 ' fox finite population First the mean is considered 


MML The UNDX creates points as given by above two equations, substituting these equations m the 
eqn (3 6) we get 




SU1( C 


x p,k = , we have 


which can be written as 


1 \k — fJ./2 

<y> =^X te „ 




1 v — 

<y>=-> x,=<x> 

// ‘ ^ = 0 


it' 

wheie < x > is the mean of the parental population, therefore the mean of the parents is preserved 
hy | he UNDX operator So it satisfies postulate 1 Here y is the n-dimensional vectoi 


hcn/cmcp Armlyvs o/ the UNDX_ operator^ The term D in the equations of the children points as ob- 
tained by the UNDX is the normal distance of the third parent from the line connecting fiist two paients 
is giv<‘n by the following expression 



D 2 = |x 3 - x 1 ! 2 (i -( (^-xT^-x 1 ) ^ 
\ V l x3 - ic 1 ||x 2 - X 1 ! / J 


(3 36 ) 


\n anahsis snnilfU to that, has been performed for the operators described above would involve m 
(hl s < use the dot ei munition of the expectation of the quantity (E '^~\De 3 ) 2 which would fmthei 
!>•'«' die 111 Uu ’ denominator too This is difficult to evaluate because the distribution of the 

paiontal population is unknown, however a simplified analysis can be done by considering the paiallol 
(omponent onb io considering only the first two terms in the equations for the generations of the 
(lnldion solutions Considering the parallel component only the children points as generated by the 
bNDX opeiator will be given as, 


Vi £,di (3 37 ) 

Vi ~ £di (,3 38 ) 

It lias the' same foim as given by equations (3 1) and (3 2) Above equations are for the i th component 
\ (oiiipansoii with the eqns (3 1) and (3 2) yields value of parameter P in this case as 


/? = 2 £ 

hoi o i is the normally distributed random number following 2V(0,cr|) To get the variance evolu- 
tion equation m this case, we need to calculate the quantity /f 2 In equation (3 15), the probabihn 
(list i ibution foi fi is givcm by 


pG8) = -4=e"£ 

(TV 27T 

Using above eqn and /? = 2£ m equation (3 15), we get 

_-£A 

-.e d(. 


oo i 


/ oo 

-oo (2Cr 

fOO 1 £ 2 

P 2 = 4 / e—j==e-^di 

J —oo (J^V 2 . 7 T 


substituting = t, we get 


(3 39 ) 


(3 4()l 

(3 41) 


W=~[°° t 2 t e->‘d, 

V 7 T J —oo 

(3 42 ) 

3 5 = ^f(- ie -.'r + r e-‘‘ it] 

V 7 T [V /-oo j.00 J 

(3 43 ) 



Since hnif-rx t< 




0 and 


I X 2 . — 

I — xi ^ ^ V“? substituting these above, we ha\e 


P = 4<r 2 


(3 44) 


Using this value of rt~ m oqn (3 14), we get the variance evolution equation foi the UNDX opoiatoi 


(IS 


e 2 [y] { 9 ) =a 2 [yf ) 


1 + 


4cr 2 - 1 1 


(3 45) 


2 /j, j 

Hoio (T — (7c hiom the above evolution equation, for variance to increase, the terms in the biacket 
need to he gieatei than 1 Doing so yields, 


(“6) 

Tlius foi a given value of a ^ the population size should be greater than above value Note that this 
equation is foi tin' UNDX opeiatoi with only parallel component but it can give an idea on how much 
population size* should be ( hosen to get the desired behaviour of the crossover operation 
Remarks 

Coinpaiing the equations (3 35) and (3 45), we see that the both equations are same except m equation 
(3 45) the population size teini also comes It means that the variance evolution of population depends 
on the population size also The minimum population size which increases the population variance is 
given by eqn (3 45) Kita et al (1998) suggested the value of the term cr 2 to be 0 25 to keep the 
covanance of the population same but as can be seen from equation (3 45) that foi this value of cr| 

I lie valiant e of the population will decrease by a factor of L over the generations The validity of the 
equation (3 45) is also demonstrated later in this Chapter 


Simplex Crossover. The Simplex Crossover generates one offspring by recombining m + 1 paients 
wlieie m is liumbei of decision variables The procedure of creating the offspring is restated m the 
following 


1 Choose rn + 1 paients from the parental population randomly Let the parents be x° x 2 , 

2 Calc ulate the centre of mass of the parents chosen above as, 

x = 1 x J 

p m + 1 *“7= o 

1 Geneiate 7 *, which is random number given by, 

r k = (u(0,l))*+i for k = 0, ,m - 1 


(3 47) 


(3 48) 


Hoio u(0, 1) is uniformly generated random number between 0 and 1 



4 Cal< ulafe Xk and Ck as below. 


X k = x p + e (x k - x p ) (3 49) 

C k = / ° for k = 0 

l r k-i(Xk_i - Xk + Cfc_i) for k = 1, ,m (3 50) 

when 1 ( is the expansion late 
5 An offspring is given by 

^ = Xm + C m (3 51) 

Previous Work 

Higiu hi rsutsui and 7nmamuia (2000) did the analysis of the SPX operator for infinite population 
( iise Thev determined the mean and covariance of the population for infinite population which die 
described in the following 


UlM Considering the mean of the parental population as < x > This and (3 49) yield < X U -\ - 
\ t >= 0 Using this and (3 50), we get < Ck >=< r^_ j >< Ck - 1 >= 0 by induction Using this and 
(3 51) we get < C > = < C m > + < X m >=< x > 

Thus the mean of the paiental population is preserved by the SPX operator for infinite population 


Couauance Let (rn + 1) denote the number of parents The covariance matrix of the distribution of 
(he offsprings given by SPX is given by, 


7, 


1 


y 


m + 1 


1 + e^ 


m 


m + 2 


7i 


y 


(3 52) 


fioin above equation it, can be seen that the covariance matrix can expand or contract depending on 
the value of characteristic parameter e and number of parents taking part m recombination, m + 1 

Analysis of SPX operator for finite population. 

In tins section the analysis of the SPX operator will be done as according to the formulation done by 
Bc'vei and Deb (1999) Since the SPX operator uses more than two parents, the analysis has been 
done c onsider mg different cases of recombination involving two parents, three parents and a generalized 
(’(liiation foi M paients has been obtained In the following these cases will be considered and mean and 
'•inane e cliai acter isticfa of the children population will be checked In the analysis all parents, expanded 
paients factors C and the child are vectors and the calculations will hold for all the variables 
Two Parent. Case 


In case* of two paients, let xq and x\ be the parents The centre of mass of the paients is given as 



Tin' iHiiciom mnnbei - u whoie u is a uniformly generated random number between 0 and 1 
The paieuis aie expanded to A 0 and \ l by a factor of expansion late e, with iespect to the centre of 
mass as 


v 1 + € 1 — e 

A 0 — x 0 + —x x ( 3 54) 


f € 1 4~ € 

Ax=—xo + —xx (3 53) 

The factors Co and G'i aie given as 


Cq = 0 


Cl = r 0 e (x 0 - Xx) 

The offspnng will be created as y = Xx + C\ and would be 


- Wj xx (3 56) 

Mam of the duldu-n population The mean of the children population as generated by the SPX will 

he 


1 — c 


+ roe xq + 


1 +e 


1 -r— J=n 

<»>= -X'-a 

Substituting for y m from the eqn (1 54) into the above equation, we get 


(3 57) 


1 V — an=fi 

< y >= -\ 

u*-'m = 1 


*>m=n 




1 -e 


+ xo,l + 


1 + e 


roe Ei ,i 


(3 58) 


2 7 u ’ V 2 

As is clear from the above equation that the SPX does not preserve the mean of the parental 
population in case of the finite population instead it depends on the random number r 0 However if we 
take the population infinite it preserves the mean as is shown below, 


< y >- 


1 - e \ (1 + 6 

— — + r 0 e s 0 + ( — r 0 e ) Xx 


since < t 0 >=< u >= \ and < xo >=< Xx >= x, v,e have 


1 — 6 e\ _ ( 1 + e e 

"T~ + 2r + (~r ~2 ix 


wine h will finally give <y>=<x>=x Thus SPX preserves the mean of the parental population 
in case 1 of infinite population but for finite population it does not 



)«namf <_>[ thv tUtl dn-n population From equation (3 8), we have variance of the childien popu- 
lation as 


ct 2 [y] = E[Var{y}] = Var{y} 

Inn o Vai )\ } is defined as 


(3 39) 


(3 60) 

So to deteiimne the expected population variance of the children population, we need to calculate 
the expectation of the quantity (y m — < y >) 2 Here too the determination of this quantity will involve 
the pioduc ts i, i,i ,i and the expectation of these products is defined as, 


f at 2 , 

x t,k x j,l — S -2 

Now consideiiug the k th sum terms, we have 


if i = j A k 
otherwise 


(3 61) 


in - < i/ > ■ 


+ '0 ( J 1 0,A + 


/ 1 + 1 


V 


Xi ,fc 


1 

i, 


l=n ( 1 
0 


+ r 0 e xqj + 


/ 1 + 6 


(- 


- Toe 1 1 / 



Squai mg t lie' above' equation gives, 

(<A-<*/» i = ( i f i + w) (l-i) 4* + (i—) 


(3 62) 


1 



Tpi-f f f 1 — f 

t-W \V 2 


+ r 0 e 


x o,i + 




2 

+ 2 


ri- e 2 

4 


, 2 2 2 
+ r 0 e - rge 



2 

2-0 ,k 1 1 / 



Attei substituting in (3 60) taking (3 61) into account, we get 





\jnj(nu£ of the (Jnldren population From equation (3 8), we have variance of the childien popu- 
lat ion as 


a [y\ = E\Var{y}\ = Var{y} 


(3 59) 


hem Vai{y} is dehned as 


Var{y } = !* (Vm- < V >? 

fl ' 771=1 


(3 00) 


So to determine the expected population variance of the children population, we need to calculate 
the expec tation of the quantity (y m — < y >) 2 Here too the determination of this quantity will involve 
tin' pioducts i i^ijj and the expectation of these products is defined as, 


/ tr 2 , 

X i,k x ],l ~ | _2 

Now considering the k th sum terms, we have 


if i = j A k = l 
otherwise 


(3 61) 


1 - e 

m -<</>=! 7. + 


r 0 £ ) x 0 ,k + - r 0 ej Xije - ("T^ + r ° e ) X °'‘ + (“T“ ~ '° f 1 1 1 1 


V + ro£ ) ( 1 “ l) x °' k + - ro£ ) (‘ - 


1—fjL 




1 — e \ /I + e , 

— Y~ + r oe J %o ,i + I — 2 r o e J Xi,i 


Squaring the above equation gives, 


0a- < y >) 


1 -e 


+ r 0 e ( 1 


1 V 2 A +e 

< k+ {~r 


roe 


1 ” y) 


(3 62) 


E i—f.1 

l^k 


1 — e (1 + e 

+ r 0 e xqi + 


roe xy 


+ 2 


1-6 2 


, _ ,2 _2 2 
+ — Tq€ 


1 | 3o k 1 U 




1 -e 


+ roe xo,i + 


l + € 


roe iij 






1 \ — -s, l—fj> 

l^k 


l-e \ fl + e 

— 2 f r o e J ®o,i + ( — g r 0 e J iy 


Alt ei substituting in (3 60) taking (3 61) into account, we get 


° 2 [y] = ( Vm ~ < y 

fj, — 'm—l 


59 



L J u*-'rn= 1 


~ + 2r 0 V - -l(lXjL +2 Ttf- 2 Ttf 


9” — ? 

X z — l~ 


Suite ; 0 = \ and r$ = we have from the above equation aftei substitution, 


' 2(s+1) [y] = \ 


1 + T~“ f 1 + T 

3 P \ 3 


r 2(fi) 




This gives the variance dynamics for the SPX crossover operatoi m case of 2 parents 


(3 63) 


Three parent case 

In tins case, let xq, x\ and X 2 be the parents, so the centre of mass of the parents is given as 


G = g (®o + ®i 4-x 2 ) 


(3 64) 


The landom numbers ro and ri will be r 0 = tt(0 1) and n = (u(0, l))i Here u(0,l) is a unifoimlv 
geneiated random number between 0 and 1 
The ver trees of the extended srmplex wrll be 


v 1 4- 2e 1 — e 1 — e 

Xo — g — xq 4 — x\ 4 — x 2 (3 65) 

v 1 — € 1 4- 2e 1 — € 

X\ = - — Xq 4 — X\ 4 — J.0 (3 66) 

„ 1 e 1 — e 1 4- 2e 

x 2 = - 3—^0 + - 3 — + g x 2 (3 67) 

The factors Co, C\ and C 2 are grven as 


6-0 = 0 


Ci = r 0 e(x o - xi) 


C 2 = r 0 ri€x 0 4- (rje - rorie) x x - r l ez 2 


The offspring will be, 


4- rone xq 4- 


1 -e 


4- ne - rorie 2,1 4- 


/l + 2e 

V 3 



x 2 


(3 68) 


60 


y — x 2 4 - C 2 — 


3 



Remarks 


Fiom the above equation it is clear that the variance of the population generated by the SPX opeiatoi 
depends on the characteristic parameter e, number of parents taking pait for the ciossovei and on the 
populat ion size too 

F 01 tlie vanance to increase as by postulate 2, the quantity in the biackets on the light, side ol above' 
equation should be gieatei than M This gives us the minimum population size foi a given value of 
paiamotei e and M as follows, 


A* > 


1 _i_ M- 1 2 
1 + M+I 6 

1 _l M-l 2 _ jur 
1 + M+l 6 M 


(3 73) 


If we compare the equations (3 52) and (3 71), we find that both equation aie same up to two terms 
In ( ase of finite population the we see that the variance evolution also depends on the population size 
Latei in this Chapter it is validated with the simulations The investigators of SPX have argued that 
to keep the covariance of the population same the characteristic parameter should follow the relation 


e — VM -I - 1 


It is deal from equation (3 71) that this value of e will always reduce the vanance and in turn the 
(ovanance of the population no matter how much population size p we take For the vanance of the 
population to increase the value of population size should follow equation (3 73) 

One more thing to note here is that for a given value of the number of parents the value of parameter 
f should be greater than (M + 1) for variance to increase If e < M + 1, the variance of the population 
w ill always deciease independent of the population size 


3 2.2 Comparison with Simulation Results 

The piedictive quality of the evolution equation for different crossover operator can be evaluated foi 
diffeient, operatois by making GA runs on a flat fitness landscape Heie theoretical prediction are being 
c onipaied with the simulation results for SBX-77, BLX-a, FR-d, UNDX-cr^ and SPX-M-e 

Figuie 3 1 compares the formula (3 21) of the population variance dynamics (line lepiesented with a 
+ and dotted line lespectively) with the simulation using SBX operatoi Figuie 3 2 compaies the foi mula 
(3 21) of the population variance dynamics (line represented with a 4- and dotted line respectively) with 
the simulation using SBX operator 

Figuie 3 3 and Figure 3 4 compares the results of the GA runs for BLX-0 0 and BLX-0 5 lespectively 
with the pi edict, 1011 given by equation (3 24) Figure 3 5 and Figure 3 6 compaies the simulations of the 
RGA using FR-0 5 and FR-0 7 operators with the evolution equation given by (3 28) 

Figuie 3 7 shows t^he vanance dynamics in case of UNDX without perpendicular component as given 
by equation ( ,e = 60 with <7 ? = 0 75 and for popsize=6 with = 0 55 Figuie 3 8 shows 
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Figuie 3 1 Evolution of the square root of the expected population variance for the SBX operatoi 
m the flat fitness landscape Population size=10 with 77 = 2 (upper line, displayed by +, simulations 
displayed by o) and rj — 5 (lower, dotted line, simulations displayed by x) The population has been 
landomly initialized with variance 1 The simulation results have been obtained by averaging over 3000 
independent iuns 



Figuie 3 2 Evolution of the square root of the expected population variance for the SBX opeiatoi m 
tin' flat fitness landscape Population size=300 with 77 = 2 (upper line, displayed by +, simulations 
displayed by o) and 77 = 10 (lower, dotted line, simulations displayed by x) The population has been 
landomly initialized with variance 6 The simulation results have been obtained by averaging over 100 
independent runs 


the vanance evolution as given by equation (3 45) for popsize = 60 with ay = 0 50 and foi popsize = 
10 with ay = 0 35 

Figuie 3 9 and Figure 3 10 show the evolution of variance according to the formula (3 72) m case of 
two paients for the simplex crossover operator with e = 1 5 and e = 2 0 respectively 

Figuie 3 11 and Figure 3 12 show the evolution of the variance according to the foimula (3 72) 111 
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Figuie 3 3 Evolution of the square root of the expected population variance for the BLX operatoi 
in the fiat fitness landscape BLX-0 0 for population size 60 (upper line displayed by +, simulations 
displayed with a o) and 4 (lower dotted line, simulations displayed with a x) The s im ulation started 
with landom initialization with variance 1 The results have been obtained by averaging over 2000 
(popsize 4) and over 100 (popsize 60) independent runs, respectively 



Figure 3 4 Evolution of the square root of the expected population variance for the BLX operator 
in the flat fitness landscape BLX-0 5 for population size 60 (upper line displayed by +, simulations 
displayed with a o) and 4 (lower dotted line, simulations displayed with ax) The simulation started 
with landom initialization with variance 1 The results have been obtained by averaging over 2000 
(popsize 4) and over 100 (popsize 60) independent runs, respectively 

case of tluee parental recombination of the Simplex Crossover operator with e = 2 1 and e = 2 25 
K'spoctively 

Figure 3 13 and Figure 3 14 compare the variance dynamics of the SPX with five parents according 
to the equation (3 72) with expansion rate e = 2 5 and e = 2 75 respectively with the RGA runs 

As is clear from the simulation results, each of these operatois is able to exhibit, exponentially 
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Figure 3 5 Evolution of the square root of the expected population variance for the FR operator in 
t he flat fitness landscape with d = 0 5 for population size 60 (upper line displayed with a + simulation 
shown by a o) and for population size 8 (lower dotted line, simulation displayed with a x) The 
simulations started with a random initialization of the population with variance 1 Results have been 
obtained by lunning the simulations over 3000 (popsize=8) and 100 (popsize=60) independent runs 



Figuie 3 6 Evolution of the square root of the expected population variance for the FR operatoi in 
the flat fitness landscape with d = 0 7 for population size 60 (upper line displayed with a + simulation 
shown by a o) and for population size 8 (lower dotted line, simulation displayed with a x) The 
simulations started with a random initialization of the population with variance 1 Results have been 
obtained by running the simulations over 3000 (popsize=8) and 100 (popsize=60) independent runs 

me leasing as well as decreasing population variance, depending on the choice of corresponding char at - 
leustic parameter valued o;,d,£i7,6) The deviation of the simulation from the theoretical pi edit tions 
aie due to accumulation of the statistical errors 
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Figme 3 5 Evolution of the squaie root of the expected population variance for the FR operator in 
the fiat fitness landscape with d = 0 5 for population size 60 (upper line displayed with a +, simulation 
shown by a o) and for population size 8 (lower dotted line, simulation displayed with a x) The 
simulations staited with a random initialization of the population with variance 1 Results have been 
obtained by i unning the simulations over 3000 (popsize=8) and 100 (popsize=60) independent runs 



Figme 3 6 Evolution of the square root of the expected population variance for the FR operatoi m 
the flat fitness landscape with d — 0 7 for population size 60 (upper line displayed with a +, simulation 
shown by a o) and foi population size 8 (lower dotted line, simulation displayed with a x) The 
simulations staited with a random initialization of the population with variance 1 Results have been 
obtained by running the simulations over 3000 (popsize=8) and 100 (popsize=60) independent runs 


nit teasing as well as decreasing population variance, depending on the choice of corresponding chaiac- 
U'listu paiametei valued, a, d,f<r e) The deviation of the simulation from the theoretical piedic turns 
aio due to accumulation of the statistical errors 
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Figuie 3 7 Evolution of the square root of the expected population variance foi the UNDX crossovei 
open at or m the flat fitness landscape with erg = 0 75 for population size 60 (upper line displayed with 
a + simulation shown by a o) and for population size 6 with erg = 0 55 (lower dotted line simulation 
displayed with a x) The simulations started with a random initialization of the population with 
\ ai lance 1 Results have been obtained by running the simulations over 3000 (popsize 6) and 200 
(popsize=60) independent runs 



Figure 3 8 Evolution of the square root of the expected population variance for UNDX operator m the 
flat fitness landscape with = 0 50 for population size 60 (upper line displayed with a + Simula ion 
shown by a o) and for population size 10 with <r t = 0 35 (lower dotted line, simulation displayed with a 
x ) The simulations started with a random initialization of the population with vai lance 1 Results lav 
been obtained by running the simulations over 3000 (popsize=10) and 200 (popsize=60) independent 


inns 
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Figuie 3 9 Evolution of the square root of the expected population variance for the SPX operator with 
two paients with e = 1 5 for population size=60 (upper line shown with +, simulation displayed with a 
o) and population size=6 (lower dotted line, simulations displayed with a x) The GA runs started with 
a landoin initialization of the population with variance 1 The results have been obtained by averaging 
own 3000 (popsize=6) and 300 (popsize=60) independent runs 



Figuie 3 10 Evolution of the square root of the expected population variance for the SPX operatoi 
with two parents with e = 2 0 for population size=60 (upper line shown with +, simulation displayed 
with a o) and population size=6 (lower dotted line, simulations displayed with a x) The GA runs 
st ai tod with a random initialization of the population with variance 1 The results have been obtained 
1>\ avei aging over 3000 (popsize=6) and 300 (popsize=60) independent runs 
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Figure 3 11 Evolution of the square root of the expected population variance for the SPX operatoi 
w ith three parents with e = 2 1 for population size=60 (upper line shown with 4- simulation displayed 
with a o) and population size=10 (lower dotted line, simulations displayed with a x) The GA unis 
staited with a random initialization of the population with variance 1 The results have been obtained 
by avei aging over 3000 (popsize=10) and 200 (popsize=60) independent runs 



Figuie 3 12 Evolution of the square root of the expected population variance for the SPX operatoi 
with thiee parents with e = 2 25 for population size=60 (upper line shown with + simulation displayed 
with a o) and population size=5 (lower dotted line, simulations displayed with a x) The GA inns 
staited with a random initialization of the population with variance 1 The results have been obtained 
b\ avei aging over 3000 (popsize=5) and 200 (popsize=60) independent runs 
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Pn 2 ,ui(' 3 13 Evolution of the square root of the expected population variance foi the SPX opeiatoi 
with hvo patents with e = 2 5 for population size=120 (upper line shown with + simulation displayed 
with a o) and population size=10 (lower dotted line, simulations displayed with a x) The GA urns 
sfaited with a random initialization of the population with variance 1 The results have been obtained 
by avei aging over 3000 (popsize=5) and 200 (popsize=60) independent runs 



Figuie 3 14 Evolution of the square root of the expected population variance for the SPX opeiatoi 
with five parents with e = 2 75 for population size=60 (upper line shown with +, simulation displayed 
with a o) and population size=10 (lower dotted line, simulations displayed with ax) The GA unis 
staited with a landom initialization of the population with variance 1 The results have been obtained 
by avei aging over 3000 (popsize=5) and 200 (popsize=60) independent runs 
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Bast'd on the variance evolution equations obtained for different crossover operators and the 
simulation results it is quite intuitive that above operators will show the similar performance for a 
paitn ulai parametei setting associated with different operators The following table shows the char- 
ai teustit paiarnetei value of different crossover operators at which these operators would exhibit the 
identical variance giowth in flat fitness landscape The values of the diffeient parameters have been 
obtained by equating the right side of equations (3 21), (3 24), (3 28), (3 45) and (3 72) 


SBX 

BLX 

FR 

UNDX 

SPX, M=2 


SP3 

C, M=3 

n 

CY 

d 


G 

/x small 

e, /j, very large 

e (for small (x) 

e (foi veiy laige fx) 

2 000 

0 662 

1 095 

0 671 

J 

1 5 400+4 

2 323 

\ 

1 6 400— A 

2 530 

3 000 

0 500 

0 707 

0 577 

\ 

j 4 000- 1 

2 000 

i 

/ 5 000- A 

2 236 

5 000 

0 419 

0 433 

0 530 

\ 

ji 375- f 

1 837 

1 

y 4 375- A 

2 092 

10 000 

0 381 

0 226 

0 508 

‘ 

jz 103- 4 

OE£l 

1 761 

/4 103- A 

fjEt 

2 025 


Table 3 1 Characteristic parameter values for different crossover operators for similar bahaviour in flat 
fit upss landscape 

Hoie M m case of simplex crossover is the number of parents taking part m ciossovei Values of the 
paiameter e are presented m two parental and three parental recombination however general expressions 
foi the € can also be obtained from the equation (3 72) 

le+^ 

Ie+30 
le+25 
le+2° 

‘i* le+15 

5T le+10 
100000 
1 

le-Oi 

Figiuc' 3 15 The performance of various RCGAs implementing different operators m flat fitness land- 
sc ape The dotted line is the theoretical line From top the operators are SPX, BLX, SBX, FR and 
lA'DX 

Figure 3 15 shows the performance of various RCGAs using different operators m flat fitness land- 
s< ape The simulation has been performed on a 30-variable problem without any selection and mutation 
The figure clearly shows that all the operators are performing m a similar manner The deviations from 
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t lit' 1 heoietic a.1 lmo aie due to accumulation of the statistical errors For the simulations the values of 
dim at ( ei ist it parameters associated with different operators is taken from the table above The values 
< in i (‘spending to the rj = 3 0 of SBX operator are taken 


3.3 Classification of Crossover Operators 

Bast'd tm the mean preservation and variance evolution properties the different crossover operatois ma\ 


be < lassified as below, 


Crossover Operator 

Mean 

Variance 

Flat Crossover 

Preserves 

Always decreases 

Simple Crossover 

Preserves 

Always decreases j 

Discrete Crossover 

Preserves 

Always decreases ; 

Arithmetical Crossover 

Preserves 

Increases for fi > ! 

Linear Crossover 

May Preserve 

May Increase i 

BLX-c* 

Preserves 

Increases for n > ! 

Extended Line Crossover 

Preserves 

Always decreases ! 

Extended Intermediate Crossover 

Preserves 

Always decreases ; 

Unfair Average Crossover 

Preserves 

Preserves 

Preserves 

Preserves 

Does not preserve 

Does not preserve 

Increases for a > 1 0 

Increases for p > ; 

Increases for fx > + 3)(/] - 1) j 

Increases for fj, > --f- - 

ITifzrp 

Increases for / j , > 

May Increase 

Fuzzy Recombination 

Simulated Binary Crossover 

Unimodal Normal Distribution Crossover 

Simplex Crossover 

Linear BGA Crossover 


Table 3 2 Crossover Operators for Real-coded Genetic Algorithms 


3.3 1 Discussion 

In the above table mean preservation means that the mean of the parental population is kept same b\ 
tl,o cluldien population and the increase m variance means the children population has increased the 
uuuntc of the parental population The crossover operator classification above is for finite population 
sue ,, In case of Simplex crossover operator, it preserves the mean for infinite population as shorn, 
cailiei section The classification has been done according to the analysis pe, formed on the meat, 
and variance evolution of the crossover operators in the earlier sections M in case of Simplex crossose, 
shows the number of parents taking part in crossover Here A, o 4, V ** ' the d, fle, cut 

, Inuat tenstic parameters associated with different operators As for as toy Connective Based (FOB] 

, ,, „„ or , ;arirp an d the variance evolution depends on the cIiokc of the 

opoiatois aio concerned the mean preservance ana cue 

, „ . Ac dismissed in Chapter 2 that these opeiatois use* 

iu/zv connectives used for crossover operation As discussed vmap 

„ , a r Tvntnft; Tf each one is treated separately none of the FOB 

some fuzzy connective foi the creation of new points u eacn one y 
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t-noim 

t-conorm 

Averaging Function 

T\(i </) = min(a,y) 

G\{x,y) = max(x,y ) 

P(X,y) = (1 - A)z + A y 


Table 3 3 Logical fuzzy connective used in FCB opeiatois 

opeiatois will pieserve the mean but with certain combination of these connective these can preserve 
t lie' moan For example the Logical fuzzy connective are shown m Table 3 3 

Fiom the above connectives if we choose T\ and G\ to create two children from two parents, the 
moan would lemain the same as that of the parental population and the variance will either decrease 
oi unnam same If P\ is used to create two children, one with A and other with 1 - A the mean will be 
preseived but the vanance m this case will keep on decreasing 

The simplex crossover operator and the linear BGA crossover operator do not preserve the mean foi 
t he finite population The simplex operator however preserves the mean for infinite population 
hoi LNDX operator only the parallel component along the line joining the parents has been considered 
m analysis Though the perpendicular component is not included m the analysis, the relationship 
between the characteristic parameter of the UNDX operator a £ and population size gives the rough idea 
of how much value of should be used for variance to increase 
The other things about different operators are as follows, 

1 For Arithmetical crossover operator any value of the characteristic parameter A<1 0 will decrease 
t lie var lance independent of the population size p For A > 1 0 the variance will increase as given 
by equation (1 36) 

2 For Unimodal Normal Distribution Crossover (UNDX) the value of characteristic parameter cr ? 
should be greater than 0 25 to get increasing population variance and for any value > 0 25 
the minimum population size p is given by equation (1 48) If the oc<0 25 the variance of the 
population will keep on decreasing independent of the population size p Note that, these value's 
aie obtained considering only the parallel component of the crossover operator 

3 The Simplex operator (SPX) does not preserve mean m case of finite population size p but for 
infinite population size this operator preserves the mean 

The above analysis has been done considering the flat fitness landscape The flat fitness landscape 
< an be regai ded as the local approximations of the real fitness function to be optimized Therefore, the 
analysis describes the local EA behaviour with the general objective to increase the local performanro 




Chapter 4 


Extensions to Other Landscapes 


Iii this Chaptei, various real-coded genetic algorithms implementing different crossover operators are 
{('sled on sphere model and ridge model for their similar performances by taking the parameter values 
horn Table 3 1 For the experiments, the second set of characteristic parameters associated with different 
( rossovei operators are chosen from the Table 3 1 The different paiameters used for the RCGA runs 
aio discussed below, 

A population size of 100 is taken for both problems The results have been obtained by averaging ovei 
10 independent runs Number of variables taken is 30 In all the simulations mutation is not used The 
( lossovei is done with a probability 1 0 A binary tournament selection is used with tournament size 
S = 2 In case of SBX, BLX and FR the crossover is done variable by variable while m case of UNDX 
and SPX, line crossover is used The characteristic parameter setting used is as follows, 

SBX r] - 3 0 

BLX a = 05 

FR d = 0 707 

UNDX a { = 0 5773 

SPX e =6 13 

The value of e for SPX operator is determined by taking number of parents M = 31 
In the following sections the sphere and ridge problems have been described and the results have been 
shown 


4.1 Sphere Model 

The sphere model is most commonly used test function chosen for studying the different algorithms 
The function used here for simulations is following 30 -dimensional function 


E 30 2 

x x i 


(4 1) 


Hcie the optimal point is at (0,0, ) In the sphere model the problem is of tonueujeme All the 

variables are initialized m x,e(-l 0, 1 0) Real-parameter GAs with SBX, BLX, FR, UNDX and SPX 



ha\n boon used to optimize this function The Euclidean distance 



ol (lie best solution in a population fiom the minimum is determined and is plotted with geneiation 
numbei as shown in Figure 4 1 



Generation number 


Figuie 4 1 Performance of several real-coded GAs with different crossover operators on sphere function 

The ordinate axis m the figure above is drawn on the logarithmic scale Prom the figure it is c leai 
t hat the RCGAs using SBX, BLX and FR are able to maintain the increased precision with increasing 
geneiation and they perform more or less m the same manner Moreover they so a linear convergence 
oi dei Linear convergence order means an exponential decrease in the residual distance to the minima 
As foi as UNDX and SPX operators are concerned, it is clear from the figure that they get stuck to a 
particular function value after certain generations They do not perform same as the other operators 
Note that the values of the parameters associated with different operators obtained are foi the fiat fitness 
landscape In flat fitness landscape there is no selection pressure In case of sphere model the lole of 
the selection opeiator also comes m to picture The UNDX and SPX opeiators aie not peifoimmg m 
1 lie same way with the parameter values as obtained for the flat fitness landscape but these operators 
c an get close to the other operators if the values for their associated parameters is readjusted to some 
otlic'i value Since m case of sphere model there is a problem of convergence so it is intuitive that if we 
induce the associated parameter value, the operator should give the enhanced performance 

Figure 4 2 shows improved performance of the UNDX operatoi on sphere model as the value of 
is induced fiom 0 5773 to 0 2 Same improvement in the performance of SPX operatoi can be seem 
(Figuie 4 3) after e is reduced from 6 13 to 4 0 This is because m case of flat fitness landscape, there 
is selection pressure and variance of the population is only controlled by the crossover operator so the 
algonthms using these operators keep on going m one direction i e tthese either increase or decrease the 





Generation No 

Figuie 4 2 Performance of UNDX operator on sphere model after the cr^ value is reduced 



Generation No 

Figure 4 3 Performance of SPX operator on sphere model after the e value is reduced 

valiant e of the population while m case of other fitness landscapes the variance growth of the population 
is tout lolled by crossover operator as well as by selection operator In this particular case since the 
pioblem is that of minimization, the search regions available to the crossover operator keep on shimkmg 
and theiefoie the GAs implementing UNDX and SPX operators get stuck So the values obtained foi the 
fiat fitness landscape may not give the same performance on other landscapes but the values obtained foi 
iho fiat fitness landscape give us an idea that in other landscapes the algorithms implementing diffeient 
c lossmei operators will perform similarly for some other setting of the characteristic parameteis 
In the simulations shown above the UNDX and SPX do the crossover on the line formed by the patents 
while the other operators le SBX, BLX and FR do crossover variable by variable The \atiable 
by vanable crossover have also been tested for these crossover operators The results are shown m 
Figuie 4 4 With the vanable by variable crossover, it can be seen from the figure that the peifoiinanc e 





of Ci A using UNDX and SPX opeiators is much improved 



Figure 4 4 The performance of UNDX and SPX operators on sphere model with variable by vaiiablo 
( inssovei 


4.2 Ridge Model 

In spheie model, there was a problem of convergence The ridge model is opposite in charactenstif 
The lidge function is defined as, 


Maximize v r x - d(||(v T x)v - x||) Q (4 2) 

where x is the n-dimensional variable vector and v is the ridge axis (or the direction vectoi specif\ mg 
the i ldge axis) Thus, the first term is the projection of x vector along the ridge axis Since the objective 



Figure 4 5 Ridge function 





FiRUio 4 6 The performance of various RGAs with different operators on parabolic ridge function 

1S to maximize the overall function, the subgoals are to maximize the distance along the ridge axis and 
minimize the distance normal to the ridge axis from the point (Figure 4 5) The parameters d and a 
govern tlie shape of the ridge functions Higher values of d makes the second term more piominent 
umipaied to the first term and therefore makes an algorithm difficult to progress along the ridge axis 
Hoie a laige value of d = 1 is used The parameter a has a direct effect on the fitness landscape 
U sually two values of a are commonly used a = 2 is known as the parabolic ridge function and 0 = 1 
is known as the sharp ridge function Here only the parabolic ridge is considered 
The ndge function has their theoretical maximum solution at infinity along the ridge axis m the seaidi 
spat (' Since the maximum solution lies on the ridge axis this function tests two aspects 

• Converging ability of the algorithm on the ridge axis 

• Diverging ability of the algorithm along the ridge axis 

In the simulation, the 30-dimensional parabolic ridge function is taken with d = 1 The ndge axis 
a 30-dnnensional vector having first element 1 and rest 0 le v = (1,0 ,0) This makes the fust 

c oordiante axis the ridge axis The RCGAs with SBX. BLX FR UNDX and SPX are being nm on 
t las tuiu tion The results are shown in Figure 4 6 

The best performance is shown by FR operator Here it is clear from figure above that the RCGAs 
with SBX, BLX and FR show the almost the same performace In the figure the ordiante axis is on 
the logarithmic scale These algorithms show the linear divergence lines which means an exponential 
an i cvise m the function value of the function however these are not exactly the same For UNDX and 
SPX operatoi, it can be seen that the RCGAs implementing these operators also increases the func turn 
value but the mcreament is very small Here again it is found that with the values obtained for fiat 




htiu'ss landsc ape the RCGAs aie not performing similar to other algorithms This is beacause m case' 
of fiat fitness landscape, theie is no preference for any area of the search space But here selection 
opeiafoi also comes into work and limits the search to a few regions with more fitness 
Although the values obtained for flat fitness landscape is not showing the same behavioui for all the 
algoiithms it, is intuitive that in this case some other values of the characterstic parameters associated 
with the eiossover operators may give the similar performance Figure 4 7 shows the performance of 
SBX and BLX operators on ridge model and values of the associated characterstic parameters with with 
I hey show the pi ogress same as that of the FR operator 



Figuie 4 7 RCGAs using SBX and BLX operators performing similar to FR operator on ridge model 
aftei altering the associated parameter value 

The RCGAs with UNDX and SPX have also been tried to show same performance as that of the 
FR operator The results are shown in Figure 4 8 for UNDX and m Figure 4 9 for SPX 

It is evident from the figure that both of these operators perform m the same way as that of the 
FR opeiatoi after increasing the values of associated characterstic parameter values In case of UNDX 
opciatoi the value of <?£ is increased from 0 5773 to 1 5 In case of SPX operator the value of e is 
me leased fiom 6 13 to 7 5 


4.3 Discussion 

In t lit' previous two sections, the performace of different real-coded genetic algorithms have been c hoc ked 
on spheie and ridge model The different RCGAs have been checked whether they will perform m a 
similai way on different problem landscapes by taking the values of characterstic parameters associated 
with various crossover operators for which the RCGAs mplementing these crossover operators will 
poifoim similarly on flat fitness landscape 
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Figuio 4 8 Peiformance of UNDX operator on ridge function after increasing the value of cr f 



Figure 4 9 Performance of SPX operator on ridge function after increasing the value of <= 

It has been found that in case of sphere function the best performance is shown by BLX opeiatoi with 
o = 0 5 The SBX and FR operators have also been able to perform in more or less same mannei but the 
UNDX and SPX operators got stuck to a value after certain number generations but the performance 
of those opeiaors was unproved after changing the value of the associated parameter In case of ndge 
hint t ion the best performance is shown by FR operator The RCGAs with SBX and BLX aie also 
poi foi liinig in more or less the same way In this case too UNDX and SPX are not able to peifoim m 
the same way as other operators do Here an increase in the characteistic parameter values of UNDX 
and SPX operator gives much improved performance and it is almost the same as that of FR opeiatoi 
This difference can be explained by noting that the analysis of different operators have been done foi 
the fiat fitness lanscape In case of flat fitness landscape there is no selective pressure and the oossovei 
opeiatoi is only responsible for the increase or the decrease of the population vanante theiefoie all 
the algonthms aie going m the same way In other landscapes such as sphere and ndge model the 




sel('( f ion opcnatoi also (omt>s into pl.iv and the population variance is controlled by both selection and 
< i ossovei opeiatois, this is win the algorithms are not able to perform in the same way with the values 
ih.il Iia\o been obtained fm the Hat fitness landscape But from the simulation results that have been 
obtained Ivy altcnng the chaiat tei st i< paiarneters values, we are able to get similar perfoimances on 
othei lanscapos This shows that tin 1 KGGAs with different crossover operatois will perform similarly 
m othei lansc apes but for some other paiameter setting of the associated characterstic parameters 
V It hough the values obtained for flat, fitness landscape for similar behaviour of RCGAs do not show 
e\a< t lv the same behavioui but these give us an idea which way to go m other landcapes 

However a theoretical analysis snmlai to that m Chapter 3 can also be attempted by considering 
the selection operator for othei landsacapes Unfortunately, such an analysis is dependent on the fitness 
landscape The important matter resulting from these simulations is that any crossover operator can be 
used with a proper associated parameter value to match the performance of any other crossover operator 
Them foie, it may not be necessary to use this or that crossover operator in practice Sticking to one 
opciatoi and experimenting with it to find out an appropriate parameter value is an ideal practical 
appioach 



Chapter 5 

Conclusion and Scope for Future Work 


The evolutionary algonthms using real number representation for presenting the problem parameters 
have been found to be very effective m solving the real-world optimization problems The real-coded 
genetic algorithm uses the real number (floating point) representation and have certain advantages 
oven the traditional binary-coded GA Two mam operators in the genetic algorithms are selection 
and ciossover There are a number of crossover operators available in the literature In the present 
work theoretical analysis of a number of the crossover opeiators has been performed on flat fitness 
landscape The ciossover operators have been analyzed for their mean preserving and variance evolution 
(haiactenstics The analysis has been done for flat fitness landscape The analysis has been done on 
the' basis of the postulates proposed by Deb and Beyer (1999) on the mean and variance character istic 
for the self-adaptive evolutionary algorithms m real-valued (unrestricted) search spaces According the 
postulate on the mean preservation, it has been suggested by Beyer and Deb (1999) that with the 
task of exploration and exploitation, the variance or crossover operator should not change the mean 
of the parental population The postulate on the variance says that the variance of population should 
exponentially increase by the application of a crossover operator The different crossover operators have 
boon analyzed according to these postulates and the validity of the theoretical predictions has been 
( hex kc'd with the simulation runs of the real-GA 

5.1 Conclusion 

In the piesent, work, crossover operators for RCGA namely Simulated Binary Crossover (SBX), Blond 
Ciossover (BLX), Fuzzy Recombination Operator (FR), Ummodal Normal Distribution Ciossover (UNDX) 
and Simplex Crossover (SPX) have been analyzed for the mean and variance characteristics The tho- 
oiotu al predictions have been compared with the simulation results The other operators such as Flat 
Ciossover, Extended Line Crossover, Extended Intermediate Crossover, Arithmetical Crossovei have 
also been analyzed The different crossover operators have been classified as shown in Table 3 2 on the 
basis of then mean preserving and variance evolution characteristics The values of the characteristic 



paiameters assoc lated with different operators have been obtained for their similar performance on flat 
hliH'ss landscape and these have been checked by running simulations on sphere (converging) and ndge 
(dmn&mg) models 
The mam observations are as follows, 

• All of these ciossover operators except the SPX and Linear BGA operator preserve the mean of 
the parental population in finite population 

• The me lease 01 decrease of the population variance by the application of a crossovei operator 
depends on the value of its associated characteristic parameter value and population size 

• The operators SBX, BLX, FR, SPX, UNDX and Arithmetical Crossover are able to exponentially 
mciease or decrease the population variance depending on choice of the associated characteristic 
parameter and the population size 

• The operators like Flat Crossover, Extended Line Crossover, Extended Intermediate Ciossovei 
Simple Crossover, Discrete Crossover always decrease the population variance no mattei how mm h 
population size is used 

• The ciossover operators Arithmetical Crossover and Fuzzy Connective Based (FCB) opeiatois aie 
deterministic in there working 1 e for any two given parents these operators always pioduce the 
same child 

• In case of the UNDX operator the characteristic parameter cr^ should be greater than 0 5 foi 
the variance of the population to increase Any value less than 0 5 would always decrease the 
population variance independent of the population size 

• For arithmetical operator the value of characteristic parameter A must be gieater than 1 0, any 
value less or equal to 1 0 will always decrease the population variance 

• Equations (3 25), (3 28), (3 32), (3 48), (3 69) give the minimum value of the population size m 
case of SBX, BLX, FR, UNDX and SPX respectively It can be seen except SBX for the othei 
operators the population size is inversely proportional to the associated characteristic parameter 
so with increasing value of the parameter, the population size will keep on decreasing and may 
( ome down to the values of 2 or 3 In such a case if we want to decrease the population vai lane e 
we can not do this m these operators but in case of SBX the population size increases with the 
mciease m the value of the characteristic parameter r\ so it easier to control the search m SBX 
than other operators 



. The simulation results show that the operators SBX, BLX, FR and UNDX follow the postulates 
on mean pi enervation and variance evolution (Beyer and Deb, 1999) therefoie these operatois aie 
good candidate foi use with RCGAs 

• The insults obtained for the sphere and ridge models show that the with the values obtained 
foi snnilai bahaviour m flat fitness landscape, the algorithms implementing diffeient crossovei 
opeiatois do not perform exactly m the same manner 

• If has been found that like flat fitness landscape the different RCGAs behave m the same mannei 
1 o they show same progress towards the optima but for a different combination of the charactei- 
lstic paiameteis associated with the crossover operators 

• The values obtained in case of flat fitness landscape give us an idea about what values of the 
paiameters to use m other landscape to get good performance eg if we have some pioblom to 
optimize we can know from the equations and the values obtained for flat fitness landscape as 
what paiametei value of the crossover operator to be used corresponding to chosen population 
size so as to get increasing variance of the population So this value give us the minimum value 
of the parameter for which the algorithm will provide good performance 

• The mam point that results from the analysis and simulations m the present work is that all 
the GAs implementing various crossover operators will perform similarly in different landscapes 
with some setting of the parameter values associated with the crossover operators This implies 
that theie should not be any preference of a crossover operator over some other because the othei 
opeiator will give similar performance for some value of the parameter of that operator So sticking 
to a single operator and experimenting with the different values of the charactenstic parameter is 
an ideal practical approach 

This shows that the processing of a RCGA can be controlled by controlling the value of the chaiat- 
t ciistn paiametei associated with the crossover operators for the particular population size 
The' \ alues of the different parameters associated with different crossover opeiators aie listed m Ta- 
llin 3 1 The table shows the parameter values associated with the different crossover operatois foi 
which they will perform similarly on flat fitness landscape 

With these obseivations, the following guidelines for designing of an efficient ciossovci opeiatois aie 

gi\ ell 


1 The ciossover operator should preserve the mean of the parental population 

2 The crossover operator should be able to exponentially increase the variance of population 



The validity o{ above guidelines can also be explained with the help of the FCB crossover opeiatois 
1 he fuzzy connectives used in the FCB crossover operators are shown in the Table 2 1 Among the 
fuin families Heneia ot al have reported that the Logical fuzzy connectrves were performing bettei 
i hail ot hoi s oil most of the problems In these operators the children are created by choosing the com- 
binations ol the' fuzzy connectives If we take t-norm and t-conorm fuzzy connective, the mean of tlu 1 
population would be pieserved and the variance will either decrease or remain same If we take the 
nun aging function the two children created by taking values A and 1 - A would preserve the mean of the 
paiental population and the variance will be decreased The fuzzy connectives of the other families do 
not piesetve the mean except the t-norm and t-conorm of the Algebraic family Thus it can be seen that 
the mean preservation is a desirable property of the EA As for as the second guideline is concerned 
Heneia et al tested these operators on the functions for which the location of the optimum solution 
is alioady known So a controlled decrease in the population variance will serve the purpose but m 
leal-woild optimization problems the information of the location of the optima is usually not known 
so it would be better if the crossover operator has the ability to increase the population variance The 
nccossaiy dec lease in the population variance will be induced by the selection operator 
With inspect to the above guidelines the Simulated Binary Crossover Operator (SBX) the Blond 
Ciossovei (BLX), the Fuzzy Recombination (FR), Ummodal Normal Distribution Crossover (UNDX) 
mo good candidates for use with real-coded genetic algorithms since these operators fulfill both of the 
above properties 

5.2 Scope for Future Work 

On the basis of the present work and results, the following tasks can be accomplished, 

• The different evolutionary algorithms employing the different crossover operators could be tested 
foi similar perfounance foi the landscapes other than sphere and ridge taking the values of cliai- 
ac tenstic parameters from the table 3 1 

• The EAs using different crossover operators can be tested on test problems to get a cleaiei pic tine 
of the properties of the crossover operator 

• Presently in the real-coded GAs, the characteristic parameter is kept constant for whole of the G A 
i mi With the variance evolution equations m hand, new evolutionary algorithms having a vaiymg 
< liaiac tenstic parameter depending on the variance of the current and previous populations ( ould 
be designed and tested 



• The concept of the mvanance suggested by Hansen (2000) for evolution strategies can be used 
with real-coded GAs having different crossover operators to test their invariance properties 



Appendix A 


Calculation of Variance for the Crossover operators as in Beyer and 
Deb (1999) 


Considering the k ,h sum terms m (3 11) Using eqns (3 1),(3 2) and (3 10), we get, 
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Putting above two eqns togethci, we get 
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Substituting the above equation m eqn (3 8), we obtain 
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Since fi k aie the samples from the same distribution, we can write df = d 2 and taking eqn 
ric c omit, we can write the following evolution equation of the expected population vanance 

a 2( S +l) = 1 ^ _ 1 + ^j a 2 (s) 
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